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FOREWORD 


This  year  the  Naval  Training  Equipment  Center  is  sponsoring  the 
Tenth  NTEC/ Industry  Conference.  This  conference  has  become  an 
important  event  in  the  continuing  dialogue  between  the  various  seg- 
ments of  the  training  and  training  equipment  communities.  Repre- 
sentatives include  sponsors,  users,  *-esearch,  development,  and 
procurement  agencies  and  industry. 

This  year's  theme,  "Resource  Conservation  Through  Simulation," 
focuses  attention  on  the  multiple  benefits  that  accrue  through  simu- 
lation. Simulation  provides  the  technological  base  for  all  training 
equipment.  Through  simulation,  it  is  possible  to  bring  that  portion 
of  the  real  tactical  world  into  the  classroom  to  support  training 
needs.  The  classroom  provides  a controlled  and  effective  environment 
for  the  individual  and  team  learning  experience.  The  utilization  of 
training  equipment  results  in  substantial  savings  in  resources. 

These  savings  include  the  fuel  that  would  be  required  to  operate  the 
various  vehicles  and  the  personnel  and  equipments  that  would  be 
required  to  support  the  training  but  are  not  directly  involved  in  the 
training.  Through  advancement  in  simulation  technology  and  training 
strategies,  manning  levels  of  instructors,  operators  and  maintainers 
have  been  reduced  and  even  greater  reductions  are  forecast  for  new 
training  device  systems. 

The  papers  published  in  these  proceedings  cover  a wide  spectrum 
of  subjects  which  have  either  a direct  or  indirect  relationship  to 
the  Subject  of  resource  conservation,  the  conference  theme.  Each 
paper,  in  its  own  way,  discusses  some  aspect  of  simulation  and  its 
relation  to  the  training  process.  The  information  contained  in  the 
papers  add  to  the  reservoir  of  information  that  will  be  used  in  the 
training  system  development  process. 


This  conference  is  designed  to  provide  a forum  for  the  effective 
exchange  of  information.  The  advances  in  training  methodology  and 
simulation  technology  reported  here  will  find  their  way  into  develop- 
ment of  effective  resource  training  systems. 


G.  V.  AMICO 

Conference  General  Chairman 
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INTRODUCTION  TO  THE  CONFERENCE 


G.  V.  Amico 

Director  of  Engineering 
Naval  Training  Equipment  Center 


Welcome  to  the  Naval  Training  Equipment 
Center's  Industry  Conference.  This  year's 
conference  represents  a major  milestone.  It 
is  the  tenth  conference  which  the  Center  has 
sponsored.  The  primary  conference  goal  is 
the  same  today  as  it  was  in  1966;  improved 
cormunication  between  government  and  industry. 
It  is  gratifying  to  note  that  the  number  of 
participants  has  increased  substantially  from 
all  sectors  of  the  training  equipment  com- 
munity. In  1966,  the  year  of  the  first 
conference,  193  attended  representing 
14  government  agencies  and  49  private 
companies.  In  that  year  the  Center  had  just 
completed  the  FY  1966  training  equipment 
r-  jrement  program  valued  at  $71  million. 

parison,  the  attendance  at  this  year's 
try  conference  is  expected  to  be  600 
^0  government  agencies  and  150 
les  being  represented.  The  Center's 
■earch,  development,  acquisition,  and  modi- 
i Ration  program  for  FY  1977  totaled  over 
$270  mi  1 1 ion. 

The  training  device  program  has  experi- 
enced substantial  growth  during  the  past 
10  years.  The  rate  of  growth  has  accelerated 
in  the  most  recent  years  and  the  forecasts 
are  for  a continuation  of  this  trend.  The 
selection  of  the  theme  for  this  year’s 
conference,  "Resource  Conservation  Through 
Simulation,"  focuses  attention  on  the 
important  role  that  simulation  has  played  and 
will  continue  to  play  in  resource  conserva- 
tion policy  and  plans.  Although  the  oil 
embargo  of  1973  focused  major  attention  on 
the  conservation  of  fossil  fuels  through 
increased  use  of  simulators  or  trainers,  that 
is  not  the  only  area  that  deserves  our 
attention.  The  training  devices  themselves 
have  increased  in  complexity  to  support  the 
complex  operational  systems  in  the  inventory. 
Advances  in  technology  have  enabled  inclu- 
sion of  many  training  tasks  not  previously 
possible.  The  long  established  role  of 
trainers  for  familiarization,  normal,  and 
emergency  procedural  training  has  been 
expanded  to  include  increased  operator  and 
team  training  for  the  tactical  employment  of 
the  weapon  system.  The  single  greatest 
advance  in  this  area  has  been  the  inclusion 
of  visual  tasks  which  have  been  made  possible 
by  both  government  and  industry  research  in 
this  high-risk  and  technically  complex  area. 

1 would  like  to  cover  three  major  areas 
where  simulation  technology  contributes  to 
resource  conservation.  The  first  and  most 
obvious  area  involves  the  use  of  simulation 


technology  in  individual,  team  and  multi- 
platform  tactical  training  systems  to 
conserve  energy,  personnel,  weapons,  and 
supplies.  The  second  area  relates  to  the 
optimization  of  trainer  system  design  for 
a stated  set  of  functional  requirements  that 
would  minimize  space  and  power  requirements. 
The  third  conservation  area  relates  to  the 
application  of  advanced  simulation  technology 
to  reduce  personnel  manning  requirements  for 
training  systems. 

Let  us  look  in  somewhat  greater  detail  at 
the  role  that  simulation  plays  in  the  area  of 
operator,  team,  and  multiplatform  tactical 
training  systems.  The  chess-like  war  gaming, 
or  Kriegspiel  introduced  by  Reisswitz  in 
1824,  was  used  to  develop  and  evaluate 
strategy  and  tactics.  Today,  the  Army's  Com- 
bat Arms  Tactical  Training  System,  a real- 
time, digitally  controlled  device,  is  used 
for  staff  training  at  the  battalion  level.  A 
typical  exercise  simulates  a tactical  problem 
involving  approximately  6,000  men  and 
1,100  vehicles.  Advancements  in  simulation 
technology  that  supported  war  gaming  were  not 
motivated  by  resource  conservation;  but 
rather  by  the  logistics  of  conducting  large- 
scale  exercises  which  were  impractical  and 
sometimes  prohibitive. 

The  simulation  technology  developed 
because  of  this  impractical i ty  provided  the 
basis  for  today's  operator  and  team  training 
devices  where  energy  conservation  is  a 
specific  objective.  At  Uje  single  and  multi- 
unit tactical  training  l^el,  use  of  such 
Systems  as  the  Antisubmarine  Warfare 
tactical  trainers,  and  the  Tactical  Advanced 
Combat  Direction  and  Electronic  Warfare 
training  complexes  leads  to  significant 
resource  savings  when  compared  with  the 
resources  required  for  the  corresponding 
operational  training. 

In  the  introductory  remarks  to  the  last 
year's  conference,  I reported  on  the  capabil- 
ities of  training  devices  in  the  inventory. 
The  resource  savings  in  men,  fuel,  weapons, 
and  supply  support  for  equivalent  operational 
training  (143,000  weapons;  140,000  flight 
hours;  140,000  ship  hours;  and  21,000  sub- 
marine hours)  is  staggering  for  one  year. 
Comparative  ratios  for  energy  conservation 
range  from  10:1  up  to  100:1  depending  upon 
the  platform  type.  Associated  manpower 
savings  approximate  5:1  for  aircraft,  25:1 
for  submarines,  and  can  exceed  50:1  for 
surface  ships.  These  factors  are  compounded 
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by  the  multiple  support  urid  target  platforms 
participating  in  the  exercises.  Resource 
savings  attributable  to  simulation  technology 
are  estimated  to  preclude  billions  of  dollars 
of  costs  annually. 

The  spate  and  (lower  reguirements  of 
trainers  have  been  increasing  steadily.  For 
example,  the  addition  of  visual  and  motion 
systems' to  basic  flight  and  weapons  system 
trainers  within  the  past  few  years  has 
influenced  this  trend.  Therefore,  the 
second  area  where  simulation  can  effect 
savings  in  resources  is  through  the  optimi- 
zation of  the  trainer  design  itself. 

Advances  in  digital  technology  such  as  micro- 
miniaturization, large  scale  integration  and 
compact  and  low-cost  mass  storage  systems 
have  lead  to  reduced  space  and  power  require- 
ments. The  computer-generated  imagery 
systems,  for  example,  require  much  less  power 
and  space  than  a camera  model  board  system 
given  comparable  system  training  performance. 
The  use  of  commercially  developed  components 
and  systems  with  proven  performance,  main- 
tainability and  reliability  reduces  develop- 
ment risk,  time  and  cost.  These  practices 
conserve  critical  developmental  resources 
such  as  design  engineering  and  the  associated 
manufacturing  and  testing  activities. 

The  third  area  where  simulation  contri- 
butes to  the  conservation  of  resources 
relates  to  reductions  in  the  staffing  levels 
for  training  systems.  The  power  of  the 
digital  computer  coupled  with  its  low  cost 
permits  the  incorporation  of  instructional 


system  features  previously  performed  by 
operators  and  instructors.  The  advantages  to 
be  accrued  from  the  judicious  application  of 
CAI  and  CMI  to  major  training  systems  have 
not  been  fully  exploited.  The  application  of 
these  features  is  not  without  agony, however. 
In  order  to  implement  the  instruction  system 
through  computer  software,  the  courseware 
must  be  defined  in  full  detail,  at  best  this 
is  a difficult  task. 

Another  area  where  simulation  technology 
will  lead  to  reduced  staffing  reguirements  is 
through  utilization  of  voice  synthesis  tech- 
nology. Machines  that  listen  and  react  to 
trainee  orders,  or  talk  to  the  trainee  based 
on  information  available  in  the  computer, 
reduce  the  requirement  for  operators.  The 
basic  concept  has  already  been  validated  in 
the  laboratory. 

Significant  progress  has  been  made  in 
simulation  technology  since  the  first  con- 
ference was  held  in  1966.  The  utilization 
of  training  devices  in  the  inventory  has 
resulted  in  substantial  savings  of  resources. 
The  role  that  simulation  will  play  in  the 
future  is  probably  beyond  our  capability  to 
comprehend.  The  goal  of  this  conference 
then,  is  to  act  as  a catalyst  and  substan- 
tially enhance  the  training  process  and 
operational  readiness  while  making  substan- 
tial reduction  in  the  resources  required  to 
conduct  that  training.  The  papers  that  will 
be  presented  in  the  next  2-1/2  days  report 
on  a broad  spectrum  of  subjects  relating  to 
simulation  and  training. 
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ri  ‘.I’lt  '<  f :h.  irveL- ; “ii  r.‘  in.I  jir'i.lurt  ion  f i uiiic  varirt'j  of  ti'nininj 
!i  ill  irfari  irrir.  Mr.  Arri.y  in  a nrnher'  f Tin  iirta  Pi  and  Alt  ha  Pi  hfit 

‘ ‘ , Arurinn  rorirty  of  M'litnry  Fnaineerr , .'ocictj 

f r .■'.7  . /• '”:i  .'tfi  vr.  An  il '^1':  , Rrr- ar-h  .To.di  ty  of  Anrrira,  Jiami  Xi , the  A"irrir.in 
;,f.  fir  Ai  r t:i‘ • or.  i Ar'r  'iiu.'tie:,  iha!  thr  Ai'nri  For 'ni  C’l'Tnuni-ationr  and 
'.  -r?'  >:•' V At\i  ’ia''  n.  Hr  ijar  ;-ai',‘  i"naima>:  of  thr  How  York  oration  the  iniitit'ute 
■'  Ati  r r:  : -I  •irnrr  and  thr  Oranar  'hiyti'r  --f  iJi,  Am./d  Foreca  Comrunieationv  and 
e:'  M 4ii;'  ' it:'' 'e.  Mr.  Amioi  hnfin  two  I’atrnin  ind  hnn  prevented  .z  i«iper  to 
thi  .'net  i t'ate  of  Hadi'’  F’t  rln.zerv  rn  Mynthrtie  Training  for  Space  Flight.  He  cc- 
ziithorrd  a piper  on  "Thr  A:  plication  of  Syr,  ter  Thpuznico  Te.zhniqueo  to  the  .Mndclinj 
f the  Military  Trainin.j  S'aater"  p'or  The  .Seventh  Annual  Simulation  Syrrposium. 
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n-.RFOHMANCi;  EVALUATION:  THE  KEY  TO  SYSTE:M  EEEECTI VENESS* 

ROBERT  E.  EISHBURNE,  JR. 

( a I span  Corj)oration 


Evaluation  in  a comiirehensive  ISU-based 
profiram  must  be  directed  toward  both  forma- 
tive and  summative  measures.  To  bo  opera- 
tionally feasible,  these  measures  must  then 
be  inteijrated  into  an  organited  data  base.  Ei- 
nally,  evaluation  must  be  tailored  to  the  par- 
ticular course  structure  and  learning  strate- 
gies inherent  in  the  system  under  analysis. 

Such  an  evaluation  system  has  been  de- 
signed for  the  Navy's  1.-2  aircrew  training 
program,  which  is  currently  under  develop- 
ment. Measures  of  learning  acquisition,  re- 
tention, and  transfer  have  been  integrated 
into  a progression  of  cognitive,  practice, 

.itid  sort  ie/scenario  type  lessons.  The  pro- 
posed evaluation  system  then  provides  for  a 
sophisticated  computer  data  base,  the 
iersatile  Iraining  System  with  associated 
.inalytical  programs.  Eigure  1 presents  a 
model  of  the  information  flow  within  this 
evaluation  system. 

formative  Evaluation  is  the  initial 
development  component  which  consists  of 
Quality  Control  and  Revision  input  to  the 
Curriculum.  Quality  f'ontrol  procedures 


involve  the  application  of  acceptance  check- 
lists to  storyboard  or  other  preliminary 
draft  instructional  materials,  while  revision 
is  based  upon  lesson,  modular,  and  course 
level  data  from  materials  tryout. 

•Summative  Evaluation  provides  Quality 
Control  input  to  the  Curriculum  via  Revision 
after  the  program  has  been  implemented  in  its 
entirety.  This  component  of  the  OA/erall 
evaluation  model  serves  the  functions  of  both 
an  internal  and  an  external  validation  of  the 
curriculum  as  well. 

The  Versatile  Training  System*,  provides 
the  compute  data  base  component  of  the  eval- 
uation model  which  forms  the  heart  of  the 
system.  T'.ts  data  base  begins  with  all 
Instrumen'.l  Systems  Development  (ISO)  docu- 
mentation leading  to  Initial  development  of 
the  curriculum  and  Is  expanded  to  Include 
updates  from  system  changes  and  revision  from 
Formative  Evaluation  and  Summative  Evalua- 
tion. These  data  sources  are  processed  by 
the  VTS  which  documents  and  facilitates  cur- 
riculum revisions  and  provides  validation 
reports  to  training  management. 


Figure  1.  Evaluation  Model 


•This  research  was  supported  under  contract  Nbl339-77-C-0003,  "E-2  Instructional  Systems 
Development  (ISD),"  for  the  Naval  Training  Equipment  Center,  Orlando,  FL. 


The  ovaluation  model  presented  in  Figure 
1 is  further  defined  by  a performance  assess- 
ment strategy  illustrated  in  Figure  2.  This 
strategy  ajiplies  to  both  formative  and  sum- 
mative  evaluation,  with  differences  occur- 
ring only  in  d.ita  collection  techniipies  and 
areas  of  emphasis.  I ach  component  of  the 
strategy  as  it  applies  to  the  two  forms  of 
evaluation  is  detailed  below. 

FOR.M/\rivi  I v,ai.(iat;hw 

Formative  l.valuation  is  applied  to  the 
three-part  training  strategy  involving  cog- 
nitive, practice,  and  sortie/scenario  lessons 
in  a continuum  from  learning  acquisition  to 
retention  and  transfer.  In  consonance  with 
the  performance-oriented  approach  to  aircrew 
training  upon  which  the  l;-2  ISO  progr.im  has 
been  based,  learning  is  evaluated  (1)  in  the 
cognitive  setting  where  the  academic  pre- 
requisites of  a sF  i 1 1 are  developed,  (2)  in 
the  practice  setting  where  the  actual  com- 
[loneiit  skills  are  developed,  (3)  in  the 
sortie/scenario  setting  where  skills  are 
integrated  and  applied,  and  (A)  in  the 
broader  setting  of  course  level  objectives 
and  criteria.  The  purpose  of  the  overall 
Formative  l.valuation  is  therefore  a method 
of  collecting  and  organizing  data  which  con- 
tributes to  curriculum  development  at  the 
lesson  level,  but  also  at  the  modular,  supra- 
modular,  and  course  level.  Thus,  no  data  is 
viewed  only  in  isolation.  Rather,  it  is 
available  for  a systems  approach  to  analysis. 

Cognitive  Acquisition  can  be  measured 
by  performance  on  multiple-choice  tests 
given  at  the  completion  of  a lesson  in  a 
carrel  or  classroom.  For  empirical  validity, 
a pretest -posttest  strategy  offers  a viable 
approach  to  its  employment.  liiis  assessment 
at  the  lesson  level,  however,  can  be  enhanced 
through  an  analysis  of  both  instructional 
frames  for  teaching  pointsl  and  test  items. 
I'at.i  for  the  analysis  of  instructional  frames 
in  tape  slide  sequences  are  derived  from 
subjects'  comments  which  are  solicited  after 
the  presentation  of  each  slide  and  its  ac- 
companying narration,  hithin  this  strategy, 
test  Items  related  to  the  frames  are  also 
presented  on  an  individu.il  basis.  All 
aspects  of  the  te.uhing  points  can  thus  be 
evaluateil  in  tli.s  manner.  Miefher  a de- 
ficiency exist-  .n  the  narrative,  the  slide, 
the  com|>at  ibi  I i t y of  the  na  r ra  t i ve- s 1 i de 
1 oinbinat  Ion , or  t fie  test  item,  the  data 
are  availabli  foi  analysis  and  subsequent 
input  to  revision. 

(.'ognitive  Retention  is  another  aspect 
of  Formative  l.valuation  when  viewed  in  its 
broadest  sense.  Ihis  can  t,e  evaluated  by 
repeating  tfie  lesson  post -test  after  a two- 
week  delay.  While  such  a strategy  goes 


beyond  the  typical  Materials  Tryout  scheme, 
it  I .an  be  conducted  on  a small  group  basis. 

I’ractice  Acquisition  is  the  first  step 
in  the  application  of  cognitive  learning  to 
the  performance  setting  and  in  development 
component  skills.  While  Materials  Tryout 
centers  upon  skills  data  as  measured  by  sim- 
ulator performance,  the  Formative  F.valuation 
must  also  identify  weaknesses  in  the  transfer 
of  the  prerequisite  cognitive  learning. 
Accordingly,  data  collection  consists  of  two 
facets.  First,  the  instructor  records  time 
and  number  of  trials  to  criterion  on  the  prac- 
tice test.  Then,  performance  deficiencies  are 
further  evaluated  by  instructor  ratings  of 
"headwork"  vs.  psychomotor  skills  deficiencies 
and  by  subjects'  comments  which  are  solicited 
as  problems  appear  within  the  practice  ses- 
sion. If  the  deficiency  is  judged  to  be  a 
psychomotor  problem,  subsequent  revision  must 
address  refinements  to  the  practice  session. 
If,  on  the  other  hand,  the  deficiency  is 
judged  to  be  a "headwork"  problem,  a second- 
ary analysis  must  center  upon  defining  the 
problem  type  as  one  of  Cognitive  Acquisition, 
Cognitive  Retention  or  Cognitive  Transfer. 

I'he  final  component  of  the  Formative 
l.valuation  focuses  upon  the  end-of-course 
objectives,  successful  performance  on  the 
NATOl’.S  exam  and  subjective  assessments.  Such 
measurement  will  require  the  development  of 
questionnaires  to  be  administered  to  both 
trainees  and  instructors. 

The  above  described  Formative  I valuation 
strategy  appears  to  integrate  objective 
measures  of  learning  with  subjective  assess- 
ments in  a manner  that  accounts  for  both 
learning  types  (i.e..  Cognitive,  Practice, 
and  Sortie/Scenarioj  and  learning  sequences 
(i.e..  Acquisition,  Retention,  and  Transfer), 
ihe  resulting  data  base  is  both  comprehensive 
and  useful  to  the  curriculum.  lo  be  complete, 
however,  the  Formative  I valuation  must  also 
include  a Quality  Control  component  as  in- 
dicated in  Figure  1.  (juality  Control  in  the 
form  of  a systematic  screening  of  all  story- 
boards prior  to  production  and  materials 
tryout  is  an  essential  function  to  be  [ler- 
formed  by  Media  Specialists  as  well  as  SMFs. 

SIWM\1  I VI.  I VA l.ll.AT ION 

Summative  l.valuation  is  best  viewed  as  a 
dual-purpose  component  of  the  overall  eval- 
uation system.  One  purpose  is  to  provide 
training  program  validation  against  base-line 
data  from  the  former  training  program  and  the 
fleet.  Ihe  second  purpose  is  to  provide  in- 
put to  Management  Feedback  and  Quality  Con- 
trol. The  former  purpose  is  achieved  as  the 
end  product  of  the  fully  im|)lemented  program 
and  requires  a comprehensive  one-time  data 
collection  effort.  The  latter  purpose 
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ri'iinirt“i  .1  continuing:  activity  ami  i *;  one 
that  I'orioilical  Iv  rrsiilts  in  reports  to  man- 
a>;t'tTiont  ami  rovi>iion  to  tho  curriculum. 

rhe  Summativc  I valuation  •;tratoKy  can 
he  comparmi  to  the  previou-Jiv  presenteil  Tor- 
mat  ive  I valuation  str.lte^:y  •i';  the  hasic  struc- 
ture <’(■  learninj;  ty|>es  anil  learning  scipiences 
remains  essentiallv  the  same.  The  only  ilif- 
tcrence  in  evaluation  structure  lies  in  the 
■ ihsence  I'T  the  Retention  (;om)ionent  . Wiile 
this  component  remains  of  interest  to  Summa- 
tive  I v;i  I u.i  t ion  . it  is  suhsumeil  iimler  the 
Ir.Ktice  anJ  hort  ie/Scen.ir  io  com|)oncnts  where 
It  t.ikes  on  an  aJ.iptivc  function. 

Miile  the  structure  of  the  Summative 
I valuation  stritoRy  closely  parallels  that  of 
the  formative  I valuation  strategy,  ilata  col- 
lection procedures  require  more  sijjnificant 
chanp.es.  CoRnitive  Acquisition  is  concerned 
onlv  with  post-test  data  fe.xcept  when  an  ad- 
vanced student  challenpes  a lesson  with  a 
pre-test'.  Records  are  therefore  compiled  on 
tine  .irid  ruimher  of  errors  to  criterion.  Prac- 
tice Acquisition  is  concerned  with  performance 
tests  data  (time  ami  number  of  trials  to  cri- 
terion! as  in  Tormativi-  Ivaluation,  but  sub- 
lects'  comments  are  no  lonper  recorded.  Cop- 
nitive  Retention  is  measured  on  an  adaptive 
testinp  basis  when  an  instructor  notes  an  ap- 
parent "headworK”  deficiency.  Scenario  Acqiii- 
citioti  iitilites  the  same  techni<|ues  as  Prac- 
tice Acquisition,  except  that  the  ada|)tivc 
test  inp  str.itepy  shifts  from  copnitive  to 
practice.  The  SATflPS  exam  and  fleet  Perfor- 
m.ince  provide  the  final  validation  data, 
lhat  [>ort  ion  of  end-of -course  data  which  in- 
cludes SATOPS  scores  and  questionnaire  re- 
sponses rel.ited  to  Rradiiates  of  the  ISIl-hased 
propram  contributes  also  to  improvement  of 
the  course  throuph  Revision  spec i f i ca t i ons . 

Ihe  Summative  Ivaluation  rejiresents  a 
shift  not  only  from  sriall  proiip  to  larpe  proup 
data  collection,  but  also  from  materials  try- 
out to  student  [lerformance.  The  former  em- 
phasis provided  by  Formative  Ivaluation  con- 
tributes to  curriculum  develoiiment  (incliidinp 
initial  revision),  while  the  latter  emphasis 
contributes  to  validation,  revision,  and  main- 
tenance. Both  formative  and  Summative  fvalua- 
t ion  are  necessary,  however,  and  can  be  par- 
ticularly useful  when  inteprateci  by  such  a 
Iraininp  feedback  mechanism  as  the  A'ersatile 
Iraininp  System. 

Ad  RSAI  11  1 TRAIMNC  SYSdlM 

Ihe  Versatile  Iraininp  System  lias 
been  planned  to  fulfill  the  role  of  an  ISI) 
data  mechanism  in  the  h-d  traininp  propram. 

A tentative  conceptualization  has  been  devel- 
oped and  is  presented  in  Fipurc  To  pro- 
vide a more  com|)lctc  utilization  of  VTS  for 
traininp  feedback,  however,  its  role  has  been 
extended  to  include  hvaluation  Data  and 


Revision  Data. 

TSD  inputs  into  ATS  consist  of  NATOPS , 
software,  hardware,  and  tactical  documenta- 
tion. These  inputs  are  reflected  in  a Task 
Analysis  (incliidinp  a lactical  lask  l istinp) 
either  initially  or  throuph  updates  penerated 
by  system  chanpes.  Ihese,  in  turn,  provide  In- 
put to  Behavioral  Obiectives  which  are  fur- 
ther defined  as  Traininp  Objectives  --  either 
fopni  t i ve/I  nabl  inp  or  Practice  and  Sortie/ 
Scenario.  (!opnitive  and  Performance  Tests 
then  follow  from  the  Iraininp  Objectives. 

I.esson  Specifications  which  proviile  both 
deachinp  Points  and  Media  Support  reflect 
the  culmination  of  all  the  above  described 
data  bases.  Ihe  foiirse  Data  Base  finally  re- 
flects the  output  of  development  in  consonance 
with  the  I.esson  Specifications.  Ivaluation 
Data  and  Revision  Data  are  two  additional 
sources  which  o|)erate  on  the  system  in  the 
manner  indicated  in  Fipiire  1. 

I A Al.llAi  IQS  INSTRIIMIM  DATA  IT.OW 

Fipiire  I presents  a conceptualization  of 
the  evaluation  instrument  data  flow  which  cor- 
responds to  the  system  described  above.  les- 
sons are  developed  by  Savy  Iraininp  Squadron 
personnel  based  on  specifications  [irescribed 
by  the  contractor  after  a com|'rehens  i vc  analy- 
sis, An  accc|itance  Checklist  i.s  then  applied 
to  the  instructional  materials  to  assure  ade- 
quacy at  the  storyboard  or  rough  draft  level. 
Materials  Tryout  follows  after  production  of 
these  materials.  This  phase  of  the  formative 
Ivaluation  makes  use  of  three  instruments  in 
the  small -group  setting:  a Taiie-Slide  Form,  a 
Classroom  Presentation  Form,  and  a Practice  f, 
Sortie/Scenario  Form.  I acli  is  used  as  .ip|iro- 
priate  for  the  tyjie  of  instruction  under  evalu- 
ation. At  the  end  of  the  formative  Ivaluation 
period  (just  prior  to  .ictual  traininp  program 
implementation)  the  Formative  Ivaluation:  Cri- 
tique is  administered  in  questionnaire  form  to 
all  participants  in  the  Materials  Tryout.  Here 
attitudes,  opinions,  comments,  and  recommenda- 
tions arc  solicited  at  the  Lesson,  Modular  and 
Course  level.  Finally,  the  Formative  1 valua- 
tion data  is  sujip  1 eraent  ed  with  me.isures  of 
learning  effectiveness  (learning  time  and  num- 
ber of  errors)  derived  from  the  lesson  lestinp 
following  each  unit  of  instruction.  Cognitive 
Tests,  Practice  I,  Sortie/Scenario  Tests,  and 
NATOPS  Ivaluation  Worksheets  [irovide  this  data. 

Summative  Ivaluation  begins  after  the 
traininp  system  has  been  revised  on  the  basis 
of  Formative  livaliiation  data,  and  is  concerned 
with  the  fully  impleaentcd  program.  As  in  For- 
mative l.valiiat  ion , lestinp  provides  the  essen- 
tial empirical  data.  Such  data  is  then  supple- 
mented with  the  Summative  Ivaluation:  Critique 
which  is  a questionnaire  administered  to  all 
course  graduates  and  staff  personnel  and  the 
"administrative  Data  Sheet"  which  is  the  respon- 
sibility of  the  Traininp  Squadron.  With  the 
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Figure  3.  Versatile  Training  Sy8tein(VTS) 
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Figure  4.  Evaluation  Instrument  Data  Flow 
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SUMMATIVE  EVALUATION  FORMATIVE  EVALUATION 


FOOT NOTES 


.ulililion.il  input  of  .1  ipioif  j onnii  i n-  cv.i  1 ii.it  i ng 
floi't  pi-rfoi'm.iiKi'  (till'  '^iinimiit  ivo  I v;i  1 11.1 1 i on  : 
lloit  li'oi.ll'.uK  I list  riimi'iit  1 tlio  Ir.iininj;  Sipi.iil- 
ron  proot-ssos  the  Suiiimot  i vo  I v.i  lii.it  ion  il.itii 
.iiul  iipO.itos  the  sy.toiti  in|nits  (NATOI’S  ChaUKcs, 
Softh.iro  iTianjjfs , ll.n-Jw.iro  (Ti.in>;ps,  anil  Tacti- 
i .1 1 M.inual  (Ti.injjos)  to  proilini’  Revision  Spcei- 
fiv.itions.  Recoiameiulat  ions  are  containeii 
therein  uhieh  may  .iffect  the  entire  training 
system  with  the  intent  of  controlling;  ami  en- 
hancing its  maintenance  ami  efficiency. 


n The  Versatile  I'rainint;  System  is 
a ilevelopment  of  the  Naval  Weapons 
Center,  China  lake. 

21  rigiire  .T  was  developeil  by  Mr.  .1. 

H.  Flynn. 

.T)  Fiftiire  4 was  developed  by  Mr.  1,. 

R.  Pennington. 
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A I'lHIUK'nMI  ‘'I  ASI:HI  MI  V!  SYSI I M 
toK  iraimm;  simihaiors 

R.  n.  IIRAVI  N and  I . I . KIIIMIC 
(Ifuor.il  I’hv'iu  s Corpor.it  HMi 


SIIVMVRI 


Unsi  hpilii  led  pov%cr  pl.int  iri'  very 

vO'.Ilv  ,iml  w.istc  otuTKy  t'l'i.'.'iiisc  th.it  clci' 
tri^:il  piu-rity  must  t tuMi  he  t r.iiismi  1 1 ed  over 
lon^jer  dist.inees  from  other  plants  to  the 
locality  whose  power  station  is  oiit-of- 
service.  Better  tr. lined  plant  operators  as 
well  as  hotter  designed  [ilant  control  and 
■ ifety  systems  are  uerm.iine  in  this  day  and 
iv;e  when  oiir  world's  emphasis  is  on  cotiser- 
it  ion  of  natural  resources. 

ihis  p.iper  presents  a I’erformance 
Me.isurement  Svstem  that  can  he  iitilired  for 
optimi.-inK  operator  tr.iininf;  efforts  aloiin 
with  lol left  inn  man-machine  operational 
research  data  on  a trainitin  simiil.itor.  Ihis 
istem  was  developed  for  the  llectric  I’ower 
Rese.irih  Institute  lll’RlI  and  further  work 
on  this  project  is  continuinn-  Ihis  paper 
presents  a basic  introduction  to  the  system, 
methodolony  incorporated  in  its  desinn,  ilata 
• ind  results  obtained,  as  well  as  future  plans 
for  the  com  inn  three- year  term. 

I . I STROIHICI  ION 
1 . 1 Bac  V n round 

Bull  scali',  real-time  simulators  have 
become  i key  element  in  the  traininn  of 
nuclear  power  plant  operators.  These 
Simulators  provide  effective  operational 
traininn  without  costly  plant  downtime  and 
they  permit  traininn  on  important  abnormal 
and  emernency  conditions  which  cannot  be 
conducted  on  .in  operatinn  plant.  In  addition 
to  their  direct  traininn  value,  these 
Simulators  offer  a unu(ue  opportunity  to 
invest  inate  important  aspects  of  power  pl.int 
operation.  In  !!>'!>,  the  llectric  I’ower 
Research  Institute  ( 1 I’R  I ) initiated  a pronram 
to  invest  in.ate  the  use  of  traininn  simulators 
tor  the  followinn  purposes: 

• lo  provide  an  empirical  data  base  for 
statistical  analysis  of  operator 
reliability  and  for  allocation  of 
safety  and  control  functions  between 
operators  and  automated  controls. 

• To  develop  a method  for  evaluation  of 
the  effectiveness  of  control  room 
designs  and  operating  procedures. 


to  support  operator  selection 
resea  rc  h . 

Ibis  effort  is  directed  by  Mr.  Randall 
h.  Pack.  Nuclear  liinmeiu  inn  ..nd  Oper.itions 
I'ep.i  rt  nioiit  , I PR  I,  ,ind  is  ,uk  i seii  by  .i  Utility 
Advisory  l.roiip  (UAUi  composed  of  represent- 
atives of  utility  companies  owninn  or  havinn 
on  order  a nuclear  power  plant  simul.itor. 
Project  pa  rt  i c i p.int  s include  individuals  and 
organi  rat  ions  with  e.xpertise  in  nuclear  power 
plant  operations  and  training,  simul.itor 
design  and  construction,  mat  hemat  i c'l  I 
modeling  of  human  operator  perfo rm.ince , tinman 
factors  engineering,  and  selection  testing. 

In  the  first  ph.ise  of  this  program.  IPRI 
contracted  with  The  Singer  Company.  Simiil.i 
tion  Proilucts  I'ivision,  to  study  the 
feasibility  of  a st  andard  i ri'd  performanci 
measurement  system  using  simulation  tech- 
niques. Singer  concluded  that  such  a program 
IS  feasible  .and  recommended  that  one  or  more 
prototype  performance  measuremetit  systi'ms  be 
developed  and  implemented  on  selected  current 
generation  nuclear  power  plant  simul.ators. 

Subsequent  to  the  Singer  study,  the 
lennessee  k'alley  Authority  (TVA)  e.vpressed 
interest  in  participating  in  operator 
performance  measurement  reseirch  using  the 
power  plant  simulators  being  constructed  at 
the  lA'A  Power  Production  Ir.iining  Center  at 
the  Sequoyah  Nuvlear  Power  Plant  site  near 
Maisy,  Tenru'ssee.  This  Ir.iining  l!enter. 
equipped  with  simul.ators  for  the  Sequoy:ih 
PWR  Slide. ir  Power  Plant,  the  Browns  I erry  BWR 
Nuclear  I’ower  Plant  .ind  the  Cumberl.ind  fossil 
fueled  plant,  will  provide  .ill  the  f.icilities 
needed  for  .i  comprehensive  progr.im  .ipplying 
simul.it  ion  techniques  to  the  study  of  pl.int 
operat i ons . 

Having  concluded  that  development  of  .i 
performance  measurement  system  is  feasible 
and  having  identified  simul.itor  facilities 
that  could  be  used  for  this  purpose,  IPRI 
initiated  a one  year  project  to  develop  a 
prototype  Performance  Me.isurement  System  for 
Training  Simulators.  Work,  was  started  on 
1 May  197b  and  the  initial  series  of  four 
exercises  was  pilot  implemented  on  the  Browns 
Ferry  Simulator  at  the  TVA  Power  Production 
Training  Center  during  the  week  of  dl  March 
1977. 


To  develop  a system  for  scoring 
aspects  of  operator  performance  to 
assist  in  training  evaluations  and 


21 


Iho  om-  yc.ii'  f i-.t  . 1 1> i 1 1 1 y ilcmonsf  r.it  ion 
I'ro  ii-it  Jcmori'.t  r.it  oil  iM.it  tlic  I’crform.iiu'c 
'■li’.iMivfmi'nt  s\stom  M.is  oxii'l  lent  pot  fnt  i :i  I 
tor  support  1 n>;  rcsc.i roll  in  the  tol  lowing 

• t ro.is  . 

• liMimn^;  t oi.  hn  i ipios  .iiul  nu-t  hoilo  lo>;y 

• llnm.in  t'.ivtors  .isperts  of  control 
room  Jos  1 jin 

• I'orsonnol  solootion 

• ilpor.itor  ro  I 1 .ill  1 I i t > .in.ilysis 
1 . -■  App  I 1 1 .If  1 ons  of  t tio  Sy  St  oni 

Iho  tochniqiios  for  Jovololiiiij;  n I’orfor'ii- 
ance  Moasurement  System  described  in  this 
p.ipor  1,  .111  bo  .iJ.iptod  to  .iny  current  plant 
simiil.itor.  I'.il.i  collection,  performance 
o' .1 1 ii.il  ion . .ind  resi'.irch  programs  can  be 
prop.irod  III  the  fashion  for  any  application  - 
be  It  aircr.ift,  chemic.il  plant,  or  military 
t r.i  1 nor . 

Simulator  I’l’i'form.ince  Measurement 
'•V -terns  appear  to  be  potentially  very  useful 
to  till  N.iv>  tr.iiiunK  community.  In  the  area 
of  tr.iiniiij;  evalu.it  ion,  they  offer  the 
l>otiaiti.il  t’oi  ipiaiit  1 1 .It  1 ve . St  andardi  cell 
ovalu.ifion  of  a ship  or  aircr.ift  ASW  team, 

1 t lijiht  I r<-i» . or  .in  .iir  defense  to. im.  Vof 
only  could  tiu’  operational  re.idiness  of  the 
to.im  bo  measured  .ij;.iinst  a Inown  st.ind.ird, 
but  the  o f I o,  t 1 . eness  of  the  t r.i  i n i iij;  could 
So  a--o' sod  hy  comparison  of  pro-  and  post - 
training;  e\ a I u.it  i ons  . (he  use  of  an 
imp.irti.il  instrument  such  .is  the  simulator 
computer  to  .i-sist  with  jierformance 
or  a 1 ii.it  ions  c.in  also  provide  mori'  consistent 
.iiid  useful  moasiiri's  of  performance  than  those 
Helior.itod  by  human  evaluators  alone, 
ospoci.il  ly  in  an  environment  where  instructor 
turnover  is  reliti'.e’y  rajiid, 

for  the  S.u>  , tactical  dove  1 ojiment 
reipiires  dat.i  on  man  machine  performance,  in 
the  -ame  nuinner  that  such  data  is  neinled  for 
rese.irch  in  the  ll’ftl  I’erformance  Measurement 
System,  bith  ,i  hij;h  fidelity  simulation,  the 
e t fei  t I ; eness  of  new  t.ictics  and  hardw.ire  can 
b<’  evalii.ited  in  the  seiii i cont  ro  1 1 eil  environ 
ment  of  the  training  simulator.  Operator 
performance  and  h.irdware  deficiencies  can  he 
identified  precisely,  iml  .ipprojir  i at  e action 
inifi.ited  to  correct  these  problems.  In  an 
era  of  funding  restraints,  the  use  of 
training  simulators  to  develop  such 
operational  data  appears  to  be  much  more 
cost-effective  th.in  the  use  of  numerous 
larne-scale  fleet  exercises.  Additionally, 
data  collected  in  real-lime  on  the  trainers 
IS  siibiect  to  far  fewer  |>erf iirha t i ons  than 
data  colleited  at  sea.  Obviously  use  of 
sopti  1 St  1 cat  ed  simulators  will  nut  eliminate 


the  need  for  trainiiij;  exercises  at  se.i,  hut  a 
(iroper  mix  of  simulator  and  at-sea  exercises 
could  result  in  imjiroved  tactical  development 
data,  gathered  in  a more  cost-effective 
manner . 

1.^  I’roJ^'ct  .btani_s 

riie  following  summarizes  the  progress 
made  on  this  project  between  .lanuary  1,  Ih?? 
and  May  1,  I'.l'?. 

• The  prototype  I'erformance  Measure- 
ment .System  was  successfully  pilot 
implemented  at  the  Urowns  ferry 
HKIl  Simulator.  four  test  exercises 
were  run  several  t imes  during  the 
pilot  implementation  wei'k.  Ihe.e 
test  exercises  were:  Keactor 
Criticality,  Plant  Startiin,  SCRAM 
from  IliRh  Power,  and  Main  Steam 
Isolation  Calve  IMSIVI  Closure. 

• Ihis  p,i]ier  cont.iins  the  d.it.i  and 
analysis  for  three  of  these 
exercises,  namely:  Reactor 
Criticality,  Plant  Startuji,  .ind 
SCRAM  from  HirIi  I'ower.  Ihese  three 
exercises  were  carefully  retiewed 
hy  (leneral  Physics  and  several 
computer  proRr.im  updates  were  made 
for  each.  It  is  belieted  th.it  these 
three  exercises  are  presently 
complete.  Ihe  evaluation  coiiiiuiter 
|)roRram  for  the  MS  I \ exercise  is 
currently  nearinR  completion  .it 

the  time  of  this  writ  iny. 

• Human  factors  spec  i,i  lists  from 
Lockheed  Missiles  and  Sir  ace  ( I MSC  | 
observed  the  man-machine  interfaces 
associated  with  the  exercises  as 
they  were  beiiiR  run  on  the  Urowns 
ferry  Hh'R  IrainiiiR  Simulator.  I hey 
also  Interviewed  each  of  the  partic- 
ipants following  the  exercises. 

Ihe  report  of  their  findiiiRS  is 
published  in  a rei'ort  entitled 
"Pilot  Study  Perform. nice  Measurement 
System  for  irainiiiR  Simulators," 
li'Rl  Project  RP  '(.'.I- 1 , dl-J.S  March 
Ih"'’,  by  .1.  I.  Semin. If, 1 .iiul  S.  K. 

I cKe  rt  , April,  Id'".' 

• br.  Rich.ird  S.  U.irrett,  bi  rector  of 
the  Ap|ilied  PsycholoRV  bivision  of 


Ihese  re|iorts  are  included  in  .i  (leneral 
Physics  Reliort  entitled  "llectric  Power 
Research  Institute  Project  RP  "(dl-l, 
I’erformance  Measurement  System  for  Ir.iininR 
Simulators,  Ihird  ProRiess  Report,  ilP  R-.vJI, 
May  I't??,  by  f . kupiec  and  R.  b, 

(Ir.ives . 
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flic  Stevens  Itisflfiife  o(  I evhno , 
obserwil  the  pilot  implementation  of 
tins  prototyi'e  system.  lie  lias 
prepared  sii>;j;est  ions  with  regard  to 
rese.irvh  in  operator  select  ion  and 
presented  them  in  a report  entitled 
"kepi'i  t of  Ohservat  ions  Maile  on 
March  J1  and  at  the  TVA 
s 1 mil  1 .It  or * 

• hr.  Ihomas  H.  Sherid.in  of  Mil,  a 
member  of  this  project  team,  observed 
the  pilot  implementation  exercises 
and  has  made  suggestions  regarding 
future  evalu.ttion  exercises.  He 
suggests  that  Casualty  Identification 
and  Control  Prills  (CICO'sl,  of  short 
time  duration,  bo  i ncorpora t eil  for 
some  future  exercises.  Ixercises  of 
this  sort  would  he  a potenti.il 
source  of  much  operational  research 
d.ita  because  each  CICIt  could  be 
performed  many  t imes  by  many 
operators.  He  has  also  suggested 
drills  of  longer  time  duration  to 
provide  data  relevant  to  the  A.SSI- 
NhtiO'  decision  concerning  the 
reliability  of  operator  diagnosis 
and  response  as  a function  of  time, 
t'r.  Sheridan  has  prepared  preliminary 
ideas  for  utilization  of  these 
exercises  for  future  research. 

• The  computer  data  presented  is  also 
compared  with  the  siibjecttve 
instructor's  evaluation  for  each  of 
the  test  exercises.  The  instructor 
data  proved  invaluable  in  verifi- 
cation of  the  validity  of  the  test 
exerc ises. 

• Ihe  use  of  exercise  videotaping  was 
incorporated  during  the  test 
exercises.  Ihis  was  a valuable 
review  tool  for  the  evaluator  and 
operator  both. 

Refer  to  Figure  1 . 


These  reports  are  included  in  a General 
Physics  Report  entitled  "lilectric  Power 
Research  Institute  Project  RP  Toil- 1 , 
Performance  Measurement  System  for  Training 
Simulators, "Thi  rd  Progress  Report,  GP-R-.121, 
May  27,  1977,  by  V.  F.  Kupiec  and  R.  1). 

'.raves . 

^A.V.S1  Standard  .N-660  "(.'riteria  for 
Safety  Related  Operator  Actions."  The 
purpose  of  this  proposed  standard  is  to 
provide  criteria  to  decide  whether  initia- 
tion or  adjustment  of  a safety  system 
provided  to  mitigate  the  conseipiences  of  a 
design  basis  event  may  be  accomplished  by  a 
hiaman  operator  or  must  be  augmented  by  an 
automatic  protection  system. 


1.1  Project  Organi  zat  ion 

In  org.inizing  this  [iroject,  IPRl 
assembled  .i  we  1 1 b.i  1 .meed  team  with  expertise 
in  several  different  fields  to  ensure  that 
the  prototype  performance  measurement  system 
would,  to  the  maximum  extent  practicable, 
achieve  the  program  goals.  The  project 
organization,  illustrated  in  Figure  2, 
includes  expertise  in  nuclear  power  plant 
operations  and  training,  simulator  design 
and  construction,  mathematical  modeling  of 
human  operator  perform.ince,  human  factors 
engineering,  and  selection  testing. 

Additionally,  and  of  paramount  impor- 
tance to  this  development  effort,  the  project 
is  reviewed  by  a Utility  Advisory  Group  fllAG) 
composed  of  representatives  from  utility 
companies  which  own  or  have  on  order  a 
nuclear  power  plant  training  simulator.  By 
having  first-hand  input  from  the  IIAG,  other 
project  participants  can  help  to  assure  that 
the  project  is  conducted  in  a manner  useful 
in  the  utility  companies. 

The  Utility  Advisory  Group  is  currently 
comprised  of  representatives  from  the 
following  utility  companies: 

• Garolina  Power  and  bight  Company 

• Consolidated  l.dison  Company  of  Sew 
York 

• lluke  Power  Company 

• Pennsylvania  Power  and  bight 
Company 

• lennessee  Valley  Authority 

• Virginia  I lectric  and  Power 
Company 

• Washington  Public  Power  Supply 
Syst  em 

• Arizona  Public  Service  Company 

Additionally,  representatives  of  the 
ANS-50  committee  who  are  currently  developing 
A.S'SI  Standard  N-660,  Criteria  for  Safety 
Related  Operator  Actions,  have  recently 
begun  formal  interaction  with  the  project 
team.  Fmpirical  data  generated  from 
simulator  exercises  can  be  of  great  value  to 
this  committee,  and  their  participation  is 
intended  to  assist  the  project  in  developing 
and  providing  this  data  in  the  appropriate 
form. 

II.  COMPUTI.R  EVALUATION  PROGRAM  Ml.THOIXlbOGY , 
PROGRAM  WRITING  AND  DFBIIC.GING 

2. 1 Methodology 

The  programming  goals  of  the  current 
F.PRI  project  were  set  forth  as  follows: 

• The  construction  of  a real-time 
simulation  module  to  collect  and 
permanently  store  on  magnetic  tape 
the  entire  contents  of  the 
simulator  1/0  buffer  at  a rate 
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Utilitv  \il\isiiry  Oniup  lll\01 

• Ki'pri'si’nt  1 1 i \ I's  t'njm  utility  lomp.in  u’S  • \iUjse  the  proji'ct  to  ensure  tli.it  the 

uhuh  own  or  h.tve  on  oriler  mule.ir  system  Is  implementeil  in  .i  minner  th.it 

power  pl.int  simiil.itors  is  most  henet'uial  to  utility 

l omp.in  i es 


General  I’hysus  Corporation 

• \ Ic.uler  in  provulint;  traiiiiiiK  services  • Kesponsihle  for  1 PH  I implementation  .il 

to  the  nuclear  imliistry  the  system 


Ihe  SiriRer  Comp.iny,  Simulator  I'rmliKts  hivisioii 

• \ leailer  in  the  desij;n  aiul  proiliict  ion  of  • Proviik'  expertise  on  simiil.itor  hi';! 

simulators  for  the  military  .iiul  for  ware  aiul  softw.ire 

I mills  t ry 


hr.  Ihomas  H.  Sheriilan 

• Professor  of  Mechanical  I nn  i nee  r i iiK  , 
Ma  ss.ichiiset  t s Institute  of  lechiiolo>;y 
■iml  lleail  of  the  Man-Machine  Systems 
l.ahor.itory  at  Mil. 

• ll.is  conducted  extensive  research  on 
mathematical  models  of  human  operator 
performance . 


• Advise  the  project  to  ensure  that  it 
is  used  effectively  to  support  the 
development  of  operator  models  and  the 
conduct  of  operator  reli.ihility 
research 


I.oclheed  .Missiles  and  Space  Company 

• lias  extensive  experience  in  human  factors 
engineering  for  the  aerospace  industry, 

• Has  completed  a study  of  human  factors 
engineering  aspects  of  nuclear  power 
control  room  design. 


• Advise  the  project  to  ensure  that  it 
is  used  effectively  in  support  of 
research  directed  at  improved  control 
room  design. 


hr.  H.  S.  Barrett 


Figure  2.  Project  Organization,  Performance  Measurement  System 
for  Training  Simulators 


Professor.  Stevens  Institute  of  lechnology 

Has  develo[)ed  and  critiqued  Selection 
Programs  for  numerous  industrial  clients, 
including  utility  companies. 


a Advise  the  project  to  ensure  that  it 
is  used  effectively  in  support  of 
personnel  selection  research 
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sufficiently  rapid  to  accurately 
determine  the  state  of  the  parti- 
cular piece  of  datum  beins  samiiled. 

• The  construction  of  a set  of 
computer  alRorithms  to  evaluate 
training  exercises  usinfj  as  a data 
base  the  data  collected  and  stored 
on  imiijnctic  tape  via  the  real-time 
data  collection  proKram. 

In  these. data  collection  programs,  a 
complete  set  of  boolean  and  analog  data  is 
collected,  which  at  a given  instant  of  time 
represents  the  state  of  the  several  thousand 
switches,  lights,  meters,  recorders,  etc., 
present  in  the  plant  control  room.  The 
reason  for  collecting  all  of  these  data  is 
that  certain  data  will  bo  utilized  in 
research  programs  to  identify  man-machine 
o[ierational  characteristics  while  other 
data  will  he  used  in  evaluating  the 
operator's  performance  for  the  given 
exerc  i se. 

I'he  principal  fiimtion  for  maintaining 
.1  record  of  all  data  is  to  enable  the 
research  .in.ilyst  to  go  hack  and  evaluate 
other  p.ir.imeters  .it  a later  time  if  deemed 
necess.i  ry . 

Itie  research  effort  currently  iimler  way 
incorporates  reviewing  an  operator's 
performance  in  detail  so  as  to  better  ilefine 
the  man-machine  operational  strengths,  as 
well  as  we.iknesses.  In  this  way,  a better 
unders  t .irid  i ng  of  operator  reliability  can 
be  obt, lined  is  well  as  the  pin-pointing  of 
pl.inf  control  shortcomings.  Ibis  type  of 
data  would  be  beneficial  for  control  room 
di-sign  .IS  well  .IS  identifying  iiuorrect 
oper.it  ional  techniipies. 

. - I’ fogr  im_  W r I t_i  ii^  jniy.  Oebugg  i ng 

Ihere  ire  five  basic  steps  in  the 
coiistiintioii  of  any  compiitei'  program: 

• (ainstruct  ..\lgorithm 

• (leiier.it  !•  Computer  Code 

• lil  t ermine  Input  li.it  a 

• lieteimine  Output  bat  a 

• bebiig  1 xerc  I ses 

The  fii-.t  step,  "(onstruct  .tlgorithro."  is 
simply  the  const  riKt  ion  of  the  logiial  rules 
by  whiib  one  evalii.ites  whatever  one  wishes 
to  ev.ilu.ite  .uni  is  independent  of  .iny 
part  mil. 11  computer  language.  Ihis  is  the 
most  cruel. il  step  in  the  construction  of  an 
ev.ilu.it  ion  program  ,ind  it  is  necessary  th.it 
It  be  done  in  coiij  iiin.  t i on  with  a know  I 
edgeahle  rea.  tor  operator  instructor, 
prefer. ihly  the  person  who  dr.ifted  t he 
exi’rcise.  Close  cooperation  between 
progr.immer  and  instructor  on  this  step  will 


result  in  a good  evaluation  program  in  a 
minimum  amount  of  time. 

The  second  step,  "(Icneratc  Computer 
Code,"  is  a FORTRAN  realization  of  the 
evaluation  algorithm.  In  other  words,  the 
algorithm  is  cast  in  a language  the  computer 
iindersf  aiuls  . The  evaluation  exercises 
written  for  this  project  were  written  in 
extended  FORTRAN  IV  except  for  certain  data 
transforming  subroutines  which  had  to  be 
written  in  Assembly  I.angiiage,  The  structure 
of  the  code  for  the  four  programmed 
exercises  is  not  identical  in  that  to  some 
extent  programming  these  exercises  was  a 
learning  process  for  the  programmer.  In  the 
programming  of  future  exercises,  it  is 
suggested  that  a technique  called  "structured 
programming"  be  adhered  to  as  closely  as 
possible.  In  this  technique,  the  code  is 
generated  from  top  to  bottom  in  such  a 
manner  that  each  block  of  code  has  only  one 
entry  point,  one  exit  point  and  no  uncondi- 
tional branches.  This  means  that  each  block 
of  code  is  independent  instead  of  inter- 
ilependent  as  is  the  case  in  most  computer 
programs  and  can  be  debugged  easily. 

In  the  third  step,  "Determine  Innut 
Data,  ' is  I umpevi  together  a number  of 
substeps:  (1)  the  simulator  instructor  and 

the  programmer  must  decide  together  wh.it 
data  is  required  to  evaluate  each  step  "f 
the  exercise.  This  data  could  be  a sw  1 1 1 h 
position,  a l imp  output,  a rod  position,  a 
meter  Indication,  or  a combln.atlon  of  one  or 
more  of  the  above.  After  these  determi- 
nations have  been  made,  the  programmer  mu.st 
consult  with  the  simulator  manuf.ict urer  •■o 
determine  where  in  the  1/(1  buffers  this 
il.it.i  resides  and  in  wh.it  form.  for  ex.implc, 

.1  certain  piece  digit.il  datum  needed  m.iy  be 
bit  1 .T  of  the  (iTl  word  of  thi'  I '0.  After 
the  locations  and  forms  of  the  d.ita  .iri' 
obt  .lined  from  the  siniiil.itor  ra.inuf  act  urer  . 
the  programmer  must  determine  how  to 
tr. ms  late  this  d.ita  into  .i  FORTRAN  repre 
sent. if  ion.  \ riiimln'r  of  st.md.ird  FOKTKA.N 

callable  issemblv  l.ingii.ige  subroutines  b.m 
been  written  to  .iccomplish  this,  for 
example,  the  st.ind.ir.i  subioiitiiu-  Tls|  h|lS 
will  process  any  niiiiiber  of  bits  of  n I/T1 
word  .ind  return  to  the  KORIRAN  i'l  .; i im  the 
boole.in  rep  resent  .i  I i on  of  tf.ose  bits. 

ITie  fourth  st  | , "Determine  Output 
D.ita."  IS  re. illy  .>nl>  a programming  sti'p  in 
the  s'l.nse  th.it  t lu-  progr.im  must  produce  a 
printout  of  erior  mess.iges  ,ind  scores.  The 
form  of  the  progr.ims  iisid  to  produce  the 
printouts  is  now  st.md.ird.  However,  in  spite 
of  this,  ,1  l.irge  .imoiint  of  time  .md 
progr.immi  ng  effort  is  expended  in  producing 
the  printouts,  I his  is  because  .i  given 
exercise  c.m  h.ive  .i  l.irge  number  N of 
possible  errors  assov  i.ated  with  if.  \ 


printout  r(’Hiiirp«;  t>N  FDRTRAN  I’rror  state- 
ments. ( urrent ly  we  are  devising  a method 
tor  the  follow-on  project  which  will  use  N 
free  form  error  messages  as  input  data  to  a 
standard  print  suhroiitiiie.  Ihe  standard 
print  siihroufine  would  utili:e  the  alpha- 
numeric string  manipul.it  ion  capahilities  of 
FORTRAN  via  the  encode.'decode  siihroiit  i ties . 

Ihe  use  of  thi.  method  will  greatly  reduce 
the  time  and  effort  currently  spent  on  this 
step  of  the  programming. 

The  last  step,  "Hehtig  Ixercise,"  is 
inoflier  one  which  requires  close  cooperation 
hetween  the  progr.immer  .ind  simul.itor 
instructor.  First,  the  Input  data  to  this 
fv.il  iition  progr.im  should  he  printed  out 
.,nd  . losily  inspected  to  ensure  that  the 
1,0  loc.itioio-  wi  re  correct  .ind  that  the 
data  suhroiitines  .ire  interpreting  the  data 
correitly.  Next,  the  evaluation  program 
should  he  run  using  data  from  exercises 
which  .ire  expecteil  to  he  error  free  and 
exercisis  which  cont.iin  known  errors.  The 
printouts  from  these  exercisics  should  then 
he  carefully  scrutinized  hy  both  simulator 
instniclor  .uul  progr.immer  :ind  .iiiy  discre- 
p.iiuies  noted,  Ihe  errors  which  are  found 
ire  u--ually  simple  ,ind  easy  to  correct. 
However,  ill  exer.  ises  which  cont.iin  lomplex 
process  control  blocks,  nonprograraming 
'■rror  i in  occiii  which  indic.ite  the  process 
is  being  mi  sev  .1 1 u.it  ed.  Major  revision  ot 
the  codi  :'..iy  then  be  necess.iry.  It  is  for 
tills  re, icon  th.it  the  use  of  structured 
pi  ogi  .iiTim  1 ng  1 e.  hn  nines  is  recommended.  11 
the  pii'cr.im  IS  striKtiired,  the  offending 
‘'loik  ot  . '.ide  will  be  logically  i ndeiieiuieiit 
ot  'thei  program  blocks  and  can  be  e.e  ily 
rep  rog  rammed . 

111.  ril.dl  IMIT  I Ml  M -M  .1. ' liA'Il  \Mi  KIslIMS 
V . I Sc  hedu  1 e 

1 1 lot  Implementation  of  the  I’e  rfo  i m.iru  e 
I.. ilu.it  ion  bystem  w,i  . perl  umed  during  the 
weak  ot  M.iich  .'1.  I'l".  It  lo'ik  pla  e it 
'he  Krowns  lerry  simul.itor  .it  the  T\  A I’uwer 
Troduition  Irainiiig  tenter.  (ius  core  i .fe.l 
of  oiiduciing  each  of  the  tom  pilot 
exercises  itilicing  l\’\  operators,  i triining 
■oordit'ilor  from  h.i  hington  i'ublu  I’ower 
ccipply  Sy.tem  and  members  ot  rhe  f.eiieral 
Thy -ICS  training  org.in  i :at  i on  . ihe  four 
exeis  ises  utilized  in  this  pilot  implemeli 
t .1 1 I on  we  re  : 

• Triticality  (Individual  Ixercisel 

• .1  RAM  (Individual  Ixercisel 

• startup  ((lrou|i  Ixercise) 

• Main  Steam  Isolation  Valve  ( losiire 
(droup  Ixercisel 


1 . Reactor  Triticality  (Individual 

I xerc  i sc 

SCI  NAR  10 

The  reactor  is  shutdown  by 
approximately  -l°Ak/k.  Seven  control 
rods  must  be  seipient  i a I 1 y withdrawn  to 
achieve  criticality.  (luring  this  time, 
the  reactor  oper.itor  must  follow  correct 
control  manipulations  to  enable  the 
reactor  to  achieve  criticality.  The 
exercise  is  terminated  when  the  reactor 
vessel  water  temperature  is  increased 
by  approximately  Id  I . 

2.  Kent,  tor  Srrom  )-ri>m  I’nwcr  Operation 

( I nd  i V idiia  1 I xerc  i se  | 

snSARH) 

Ihe  |il,int  IS  operating  at  - ad' 
p 'Wei  . After  seviT.il  minutes  of  steady 
at.ite  operation,  the  gi’iierator  trips  due 
to  a single  (ih'ise  taiilt  between  the 
generator  and  the  geiu'rator  breaker  in 
t >ie  switehyard.  The  otierator  must 
respond  to  this  trij)  iiul  the  resultant 
reactor  scram  wilhoiil  help  from  addi- 
lioiial  operators.  The  plant  will  not  be 
restarted.  '|be  exerci'ce  js  terminated 
iiiioti  beipi’,  readv  to  restart  or  conmenev 
coo  1 down . 

.V . Tlant  Startup  iliroup  Ixercisel 

SI  I SARK) 

Reactor  is  critical  at  in"-  power 
with  .ijiprox  imately  -x  Bypass  Valves  open. 
Ke.ictor  w.iti'i'  level  is  in  m.inu.il  control 
with  the  "V  Reactor  I eed  Pump  in 
service.  'Ihe  main  turbine  has  been  on 
the  turning  gear  for  two  hours  in 
|ire|i.i  rat  i on  for  startup  following 
t iirbi  ne  m.i  inteiiance. 

Startup  and  synchronize  the  Unit  in 
accordance  with  correct  procedures.  Use 
the  simul.itor  telephone  to  request  the 
fierforra.incx'  of  eioiiifions  required 
outside  the  control  room.  Ihe  reactor 
oper.itor  i responsible  for  the 
operation  of  the  reactor  including 
water  level  and  re.ictor  auxiliaries, 

Ihe  liirbine  oper.itor  is  responsible  for 
all  evolutions.  Record  the  events  in 
t he  li.i  i 1 y .loiirna  I . 

1.  Main  Steam  lsol.it  ion  Valve  Closure 

((iroup  Ixercisel 

SCI  NiXRlO 

Ihe  plant  is  operating  at  fill  I 
power.  After  several  minutes  of 
operation,  the  generator  trips  due  to 


1 I'ii.i-'i'  t.iiilt  [h'I  thi- 

r.i  t ■■  I Hill  tin-  i .1 1 u i lnr.ikcr 

III  t h.  swltctivard.  I hr  (d 

opi' I .It  ii  f.  ' mu't  n-spniul  to  tills 
tii|i  iiuJ  till'  rrsii  1 1 ,iiit  rtsutor 
SI  r. nil  .Hill  .'f.iin  ''tc.im  Isol.itioii. 

Ilii'  ohii'itivc  IS  to  vorit'y  t lie 

s.ito  shutdown  of  the  ro.Ktor  .iiid 
tiirhini'  .ind  to  st.ihili:o  loiitrol  of 
t ho  ro.iitor  prossiiro  .tnd  w.itor 
lovol.  Iho  pi, lilt  will  ho  ooolod 
down  in  t ho  isol.itod  ooiulition. 

Iho  ononiso  IS  t o rni  1 n.it  od  whon 
oouldiiwn  h.is  hoon  rst  .ih  1 i shod . 

' . d Soopo 

Iho  piinoip.il  piirposi  of  thi'i  I'llot 
Impl  omont  .it  i on  w.i-.  to  domonst  r.it  o tho 
fo.is  1 h i 1 1 1 y of  tho  I’oi  torm.inoo  I v.i  lu.it  ion 
Systom.  It  w,is  .ilsfi  lit  1 1 1 :od  to  oht.iiii 
fiirthor  I n fortn.i  t I on  on  tho  potonti.il  usos  of 
tho  systom  for  tr.iinint;  and  roso.iroh.  In 
addition,  valuable  data  was  also  obtained  to 
improyo  oaoh  of  tho  four  exoisisos. 

Hus  wooK  of  simiil.itor  oxorcisos  was 
■iiocos s fu  1 1 y lomplotod  at  tho  Browns  lorry 
s iniii  1 itor , .-Ml  of  tho  sohodiilod  o.xoro  i sos 
wore  oomplotod  .iiid  tho  followirifj  was 
.iooompl  1 shod  with  oaoh  oxoroiso; 

1.  .■\s  o.ioh  oxoroiso  was  oondiiotod, 

operational  data  was  ool looted  on 
maillot  10  tape.  Ihoso  maillot  io 
tapes  wore  subsequently  utilized  as 
data  input  info  the  oompiiter 
pro>;rani  utilized  to  evaluate  tho 
roaotor  operator  performanoe. 

d.  Iliirinii  oaoh  simulator  oxoroiso,  one 
or  more  exporienoed  evaluators 
observed  the  operat ion  and 
oomjileted  an  evaluator  check  liwt 
as  the  exercise  was  conducted.  It 
was  intended  that  these  subjective 
ova  J ua  t i on.s  prov i dc  a pro  1 i m i na  ry 
assessment  of  how  the  system 
performance  data  correlates  with 
the  observations  of  these 
experienced  observers. 

Ihe  subjective  instructor 
evaluations  will  be  used  as  a rou^h 
comparison  against  the  comjiiiter 
results.  Ihe  details  of  the 
computer  printout  is  the  subject 
matter  of  section  1.3. 

3.  lach  exercise  was  videotaped,  which 
proved  to  be  most  beneficial  during 
the  post -exercise  interviews  and 
evaluation  of  each  operator's 
performance  on  the  simulator. 

•I.  A post -exercise  operator  interview 
was  conducted  by  the  human  factors, 


'lOli'itioii  te'.tmi;,  .iiid  model  iiiK 
1.  uiisii  1 1 ,1  lit  s . Ihe  purnuse  of  I h 1 ■> 
interview  w.'i  , to  yet  d.ita  on  the 
oper.i  t 111' ' opiilions  of  the-,!- 
exeioi.e.  , I lolly,  with  hi  - jiidyemeiit 
of  the  relit  lie  difficulty  of  t he 

t.i.K'.  required  for  jie  r fo  rina  lu  e . 

Ihe  section  whiih  follow,  iiuliides  the 
dot. II  Is  of  the  computer  printout  employed  in 
the  re. i.  tor  oper.itoi  [lerform.iiice  ova  1 11.1  > 1 on  . 

3.3  t’onipiiter  I'riiitoiit  for  the  Pilot 

I mji  1 eluent  .1 1 ion  1 xercises 

lor  the  jiiirpose  of  illustration,  the 
complete  computer  printout  faisimile  from 
the  first  comiiiiter  yr.ided  exercise  c.irried 
out  at  the  Browns  lorry  simulator  is 
jil'eseiited  in  this  seitioii  iiiHyuris  j(.ij(bj 

A perform. nice  summary  for  each  of  the 
;)i  lot  implementation  runs  c arried  out  duririy 
this  [iroyram  is  presented  in  section  3 . -I 
aloiiy  with  the  instructor  evaluation  summary 
for  each  exi'rcise. 

At  this  time,  however,  let's  consider 
the  inform.ition  tabulated  in  l i.yurcsa  ia)(u) 
Note  that  the  information  presented  therein 
is  done  so  in  several  different  ways.  I his 
is  done  so  as  to  enable  the  instructor  to 
evaluate  the  student's  performance  quickly 
and  easily.  Ihe  followiiiy  data  tabulations 
are  comiiiled  in  each  computer  printout. 

I . I:vent/I  rror  Cli rono lo^y 

Ihe  chronoloR  ical  tabulation  of  key 
events  aliiiiy  with  the  errors 
incurred  is  t.ihiil.ited  t'irst.  I ,ich 
error  is  identified  .iccordiiiy  to 
Its  t y|ie  I inline  ly,  \.  B,  C or  In  \ 
listiny  of  this  t)pe  enables  the 
instructor  to  obtain  a broad  over- 
view of  the  student  operator's 
performance  in  the  exercise. 

I'iyiire  A includes  the  compil.it  ion 
of  the  classification  of  errors 
considered  in  these  exercises. 

d . I’erform.ince  .Summary 

This  portion  of  the  computer  print- 
out tabulates  the  total  number  of 
errors  incurred  alony  with  the 
maximum  possihle  score  and  actual 
score  achieved  for  the  exercise. 

For  example,  inl  iynres  3(.i)(b) 
computer  printout  for  the  criti- 
cality cxerci.se,  the  operator  was 
responsible  for  one  (1-Type  error 
and  several  D-Type  errors  in  the 
neutron  monitoring  portion  of  his 
total  exercise.  The  performance 
summary  portion  of  the  computer 
printout  tabulates  the  critic.ility 
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rvi vr/i KUDR  (■iir()noi,(k;y  n.itc: 

ISlIIMiniAl  I XI  H(  ISI  /R1  ACTOR  CRI  I ICAI  ITY  Run  ll-l 

BROKSS  I I RRY  SI^IIII.ATOR 


I IVI 

1 VI  M OR  1 RROR 

I'll'. 

IIH 

VI  S' SIC 

Oo 

00 

00 

start  t 111'  1 xc  re  i ■-e 

00 

OJ 

•u 

Operator  Commences  Rod  Withdrawal 

00 

O' 

JS 

• Railed  to  Conduct  Rod  Overtracel  lest 

R 

00 

00 

1 1 

■ Killed  to  Conduct  Rod  Overtracel  Test 

R 

00 

!*< 

1 1 

■ Railed  to  Conduct  Rod  Overfravel  Test 

H 

00 

: 1 

JO 

Reactor  Critical 

00 

:8 

IJ 

' Railed  to  Maintain  IRM  Creator  than  1 

D 

00 

JO 

1 1 

■ Withdraw  SRM  Detectors  Prior  to  IRM  Hand  R 

C 

00 

Jo 

IS 

* Railed  to  Shift  SRM  Recorders  to  Slow 

D 

00 

JO 

IS 

• 1 a 1 1 ed  to  Maintain  IRM  less  than  HSV 

D 

0f> 

JO 

J - 

• Railed  to  Maintiin  IRM  less  than  RS". 

D 

00 

■M 

JO 

Reactor  Adding  Heat 

01 

01 

1 % 

■ Calculated  Heat-up  Rate  Incorrectly 

1) 

01 

01 

1% 

1 nd  of  I xercisc 

PI  RFORVANCR  SIP1MARY 

ISDIVIDIIAI  1 \l  RCISI  /R|  ACTOR 

CRITICAI  ITY 

lOI  AI  NDMRI  R 1 RRORS 

OR  1 -XCH  (TASS 

POSSI  RRI 

I \sr; 

\ R C 

D 

St  OR! 

SCORI 

I . Sys  t era  Operat  ion 

1.  Neutron  Monitoring 

0 (1  1 

) 

3r. 

J- 

I 

CRD  (Control  Rod  Drives) 

1)  3 (1 

(1 

JS 

1.3 

K’.  1 

3.  HI’S  (Reactor  P ro t ec t i on  1 

(1  II  0 

0 

5 

1 Oi'.  n 

1 1 . I'roccss  (‘ont  rol 

1.  RCS  lemperatiire  Control 

0 0 0 

f) 

J<> 

J(> 

um.o 

2.  React  1C  ity/Power  Control 

0 (1  0 

0 

IS 

IS 

1(H).  n 

i.  RX  lionfrol 

(1  0 0 

0 

ir, 

I.S 

IDD.O 

III.  Xdm  1 n 1 '.t  rat  i ve 

0 0 0 

1 

111 

- 

■0.0 

Ml  A.S 

THIS  1 XI  RCISI 

I IMP  FACrORS 

(MINmCS) 

1 Ml  NUT  I S 1 

1.  Start  to  Achieve  Criticality 

0 

2) 

2.  Criticality  to  Point  of  Adding 

Heat  0 

20 

3.  Total  R.xercise 

0 

t.l 

Figure  3 (a).  Computer  Printout  for  Criticality  Hxercise 
Showing  Fvent/Error  Chronology,  Performance  Summary 
and  Time  Factors 
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I KRitH  SUMMARY 

IMilVIlMIAI  I \1  Rl  |S1 /Rl  AC'IOR  ( R I I' I CAI,  I I V 
I . S V SJ_I  JiAJJ^ 

1.  \cut  roil  Moiiiforinn 


TIMj_  I RROR  lYPI 

IIR;M1S:S|(' 

• l-.iili'il  to  M.iint.'iin  I RM  (oi'.itor  flwin  I S’  ll 

II  ‘ hitlulfcw  SRM  Dotoctors  I’rinr  to  IRM  A (! 

0(1:  J'.):  IK  ■ I'.uIihI  to  Shift  SRM  Rcconlcrs  to  Slow  II 

(l(l:J‘.l:|K  * 1 .1 1 I <‘ii  to  M.iint.iin  IRM  l.ois  th.in  Kri°o  li 

‘ f. Mil'll  to  Miiint.iin  IRM  loss  th.in  K.S°i.  I) 

CRH; 

riMI  I.RROR  TYI’I 

IIR:.Mr,VSI.C 

0():()7;1?K  * lailoil  to  Coiuhict  Roil  Ovortravol  Tost  K 

00:09:  )•)  * lailoil  to  foniliict  Roil  Ovortravol  Tost  R 

00:  IS:  II  • lailoil  to  fotuiiiit  Roil  Ovortravol  lost  B 

.Y.  RI'S; 

I W;  r.RROR  TYI'l. 

HRiM-INiSI  C 


So  I rrors  in  This  lask 
1 1 . PRIChSS  COMROI 

1.  RfS  I oraporat lire  Control: 

TIMI.  I RROR  TYPi; 

MR  :MIS  :'Sl.r 

No  I rrors  in  Ihis  lask 

2.  React  1 Vi ty/l’owor  Control: 

ijiNiT  TRROR  rm 

MR:MIS:Si:C 

So  Trrors  in  This  Task 

.Y.  RV  Water  l.ovol  Control: 

1 1 .Ml  I.RROR  TYI’l-. 

IIR:MIN;SIC 

No  Trrors  in  This  Task 
111.  ADMINl STRATI VT 

T I Ml  TYI’I 

MR:  MIN:. SIX 

01;01:4Y  * Calciilatoil  Ileat-iip  Rate  Incorrectly  I) 


TiRiiro  3 Co).  Computer  Printout  for  Criticality  Pxorcise 
Showing  Trror  Summary 


t \ 1 1 ( I VSN  IJ_[L\  I ||)N  1)1  I MKOK 

\ I rnir  i*MkM  li.n  i‘  ; itv  ■■itioU'.  voii  ,im|iiciu  i‘ ' with  rcv;.uil  to  |■(•.•tlt()r  s.ifcty  .ind 

.'IK'l  1 1 I oil . 

(fit  Cl  1 .1 

(I'  ll|ici  .It  Kill  tti.it  |■c■.lllt•.  III  \iol,itioii  of  .1  IcihiiiMl  S|ici  I f i I .It  1011  '..ifc'ty  limit. 

|>I  (J|nr.itioii  tti.it  re. lilt-,  in  .in  mi'-i.  ticdii  1 i-il  rclc.i'.c  of  i ,iil  io.-k  t i vc  m;i  t c r i 1 1 s to 
t tic  cm  1 1 on-. . 

|i|  (i[u-i.ition  I tilt  ic->iilt'.  in  c |ii  1 |iricnt  d.im.if;c  iciulcrmi:  t tic  nl.int  iin.iv.i  i 1 .i  ti  I c . 

K trior  wtiuti  m.iy  ti.ivc,  oi  ni.iy  Ic.ul  to.  -.crioiii.  i on<ici|tictK'c-.  with  rc^;.inl  to  rc.ictor 

-..itclv  .mil  opcr.it  ion  or  m.iy  -.iili'-t  .mt  i .i  1 1 y rciliicc  s.ifcty  m.itKitis. 

I r 1 ter  1 .1 : 

III  Opcr.it  ion  tli.it  1 m .1 1 nl.it  i‘s  .iny  iissiinipt  i on  in  ttic  S.ifcty  .\n.ilysis. 

IJI  Opcr.it  ion  th.it  rc-^iilt--  in  the  violation  of  .i  I cctin  i c.i  1 Spci  i f I co  t i on  I imitmi; 

( oiulitioii  tor  Opcr.it  ion. 

( .i  I Opcr.it  ion  tli.it.  if  iiiuorri-ct  cil . coiiUI  result  in  ;i  viol.it  ion  of  .i  Icvhiiic.il 
Spec  I f 1 v.i  t ion  S.ifcty  l.iinit. 

Ill  Opcr.it  ion  tli.it,  if  unco  r rci  t cil , coiiKI  result  in  cipiipmcnt  il.im.iijc  rcmlcritii;  tin 
pi. lilt  uri.ivu  1 lull  I c. 


I rror  wtiuti  interrupts  or  c.iuscs  ili-jir.iilcil  [ilunt  oncriition  tint  ilocs  not  illcit  or 
threuten  rc.ictor  s.ifcty. 

I'r  1 1 i-r  1 .1 : 

111  Opcr.ition  til. It  result-,  in  llu-  initi.ition  of  .in  .Miiiorm.i  1 Opcr.ition.il  Iriirisicnt 

(Jl  Opcr.ition  th.'it  viol.itcs  .in  .ipprovcil  st.-ition  proccilurc. 

( .^  I Operation  ttiat  results  in  tlic  activation  of  in  .iutora.it  ic  protect  nc  system. 


ll 

1 rrors  wliicli,  unto  t lienise  1 ve-i , do  not  degrade  pl.int  operations  dircitly  luit  which 
are  indicative  of  faulty  liulnement  or  lack  of  attention  to  detail  and.  if 
uncorrected,  may  cause  or  liecome  ,in  error  of  .mother  category. 

I r 1 1 e r 1 a : 

(1  1 

Opcrarion  that,  if  iiruoirfct  coiilJ  result  in  actuation 

prot  t 1 ve  sy St  em . 

of  .111  autom.itic 

Is’l 

Operation  that,  if  iiiu  orrei  t ed . could  result  in  tlie  liolat 
Specification  limit  inn  fondition  of  Operation. 

ion  of  a leclitiical 

I.M 

Ojier.ition  inconsistent  with  accepted  "nood  operatinn  pract 

U C‘  s . " 

HI 

(Operation  outside  ot  houndaries  of  ’’normal  operation." 

I.S) 

Operation  that  violates  an  approved  station  procoilure. 

figure  U . (' la-.s  1 f i cat  ion  of  I rrors 


t.jsks  .u  ^or*!  { fhfrr 
m.noj  V .it  ifs  . Ihrsc  .irt-; 

I s V s f rfn  < >(»<  r .i  ? n>/J 

I I i’  riH  (on t i i>  I 

ill.  \‘lm  i ?u  t ? .tt  I \ «' 

I h i 1--  1)11 1 1 r ij  1 I n T h.i  t 1 1 

tllov%s  tin-  in-t!iutur  .1 1 u.it <»r  to 
toll  .it  .1  i:l.ifK«  uhioh  m.ijor  .ircMs 
lh.it  tho  opriMtoi’  in  tr.iininp.  in:iy 
h.i\t  h.til  t\lulMt<‘ti  li  1 1 t u u 1 1 > . 

>.  1 imo  1 .ii.  t or‘- 

\ scjoir.it  t'  t .iImi 1 ,1 1 1 (ut  of  t fu' 
jmpnrt  .»nt  i*|U‘i  .it  lon.i  1 t ntios  j •> 
t ihiil  .it  Oil  V hrono  I o>i  1 o.i  1 I y to  ulon 
t it\  ftou  lon>;  It  too^  t ho  op«T.itoi 
to  iiiompli^h  t ho  .1'*^' i f;noii  t-inK. 

I I rrcir  Summ.iry 

\ oonploto  orror  summ.iry  1 dont  i f i oil 
.oA’ordinxi  to  :i  i ^piod  t.isk  .js  uo  I I 
• I - t \po  of  orror  i also  t .ihii  1 .it  {'d 
it  t ho  ond  of  t ho  oomputor  print 
out.  It  is  folt  th.it  t ho  printout 
in  this  m.inm'f  onahlos  tho 
instruotor  to  ro\  lou  t lu-  stiuli-nt's 
juTform.ini.  o in  .1  iloar,  Vs'll 
orv:anirod  m.innor. 

V J P 1 1 ot  Imp  1 omontjit  1 on  xoro  i so 

Ihoro  v%oro  J(i  runs  o.irriod  out  to  tost 
tho  foasihility  of  tho  porfiu-tnaruo 
mo.isiiromont  systom  for  training;  simulators, 

I host-  runs  inoludi'd  t lu'  four  o.xc'roisos 
disoussoi!  in  soot  ion  1 . 

As  u.O'  'diown  in  s^otion  tho 

oomputor  [irintout  d.it.i  outlines  tho  roavtor 
operator' s porformanoo  1 n sovora 1 d i f foront 
’.ay  s . 

\t  this  time,  lot  US  00ns  i dor  tlio 
o\or.ill  d.iT.i  as  oomj>iloil  during  those  pilot 
imp  I omen  t at  I on  runs  whuh  is  ourrently 
oomplfte.  Ihis  d.it.i  IS  lomfiiletl  in  .1 
t.ihular  form  whufi  oomp.iros  the  ol)iooti\e 
computer  ^r.ulo  with  the  suhjeotixe 
o\ alu.itor’s  j<r.aile  for  the  test  I’xoioises. 

Iho  foJJtiwin^  fi^.;ures  identity  t lie  oomji.i  r i son 
in  porform.irioo  >;radin>;  t>otwrori  t lie  two 
t * ohn  I <pios  ; 

• I i^uro  j ^ (ir.idin^;  fumpa  risen  for 

tho  ( r 1 1 ii. .1 1 1 1 y f xo ro  i sos 

• I Injure  0,  (Iradinx  Comp. 1 r i son  for 

t ho  S(  R^\M  I xoro  i sos 

• li^»uro  7,  (irailing  (!oinparison  for 

t)io  St.irtup  Ixoroisos 

A brief  [lorusal  of  those  dat.a  d iso  loses 
fb.it  the  oompiitor  data  oorrolates  reasonably 
well  with  tho  subjootivo  evaluations  mailo  by 


1 1)0  iD’it  motor  foi  th.at  p.artuul.ir  ox<-roiso. 
However,  tiu’re  .are  ('vei.al  exceptions  to 
this  I lose  oorrei.it  ion  in  which  the 
instruotor  ov.iluatjon  and  tlio  oomputor 
('va  I ii.a  t I on  are  -ep.iiMtod  hy  more  than 
sovcr.a  1 poroont  . 

\lthouv;h  it  was  not  tfio  ori^’inal 
intention  of  this  report  to  ev.ilu.ate  these 
<1 1 t f e renoi's  betwron  the  two  sots  of  ^ritlo', 

It  is  believed  th.it  in  .lotual  pr.iotioo  >11011 
d i f f oronoos  oould  .arise  and  wouKi  now^.anly 
h.avo  f<»  1h'  ex.ami  fU'd . 

Soition  whjoh  follows  will  consi<l«i 

the  results  of  this  d.af.i  ov.a  I u.a  t I on  mJ 
ox.inuno  t h<'  stron>iths  .iiul  possililo  duirt 
comin^^s  of  the  ooniputi'r  o'.alu.ation  JeohnupH’. 

v !>  Pilot 1 niji  I em<‘n  t .i  t 1 on  lJctM^•l•^o  Kosult  , 

.ind  Ana  1 vs  i s 

1.  \n.i  lysis  of  the  C^i  f I V a 1 1 1 y 
1 xoro 1 SOS 


Prom  tho  oomputor  printout  eif  tho 
[u  rformanoo  summary  as  oomj'*  irod  to 
tho  instructor  ov.iIu.it  ion  .is  sfiown 
in  I i^uro  3,  the  m.iior  .irr.is  of 
i^radin^i  difforonoos  wore  in 
Neutron  Monitoring,  Control  Rod 
Hrivc’,  .ind  Adm  i n i st  r.a  t i v e «ections. 

\tti‘r  .1  vlisoussion  with  t fio 
i ns  t ruo  t or/ev  1 1 u.a  t o r oonoe rn  i n^ 
this  exoioisr  tile  following  t't.t^ 
iH'O.ame  .ipp.i  laait 

a.  In  1 1 h regard  to  The  neutron 
monitoring;  system,  it  w.is 
difficult  for  the  inst  luotc'ir  to 
oontinually  determine  if  .ill  of 
tho  1 KM  dotootors  wore’  prc'porlv 
on  sc.i  1 V . 

h.  in  rovt.ai'ils  to  shifting  the  sRM 

recorders  to  slow  spi-c-d  prior  to 
dc'lector  retr.iction,  it  w.i"  felt 
hy  the  opc'rator  that  tins  tasP 
w.is  likely  to  ho  forj’otten 
because  of  other  t.isk  which 
wore  more  jM'essin^. 

0.  In  i t li  re>»ard  to  the  control  rod 
drive  srotion,  the  computer 
evaLu«ition  program  only  consid- 
ered one  method  of  determining 
if  the  rod  had  been  pn^perl) 
overtravel  tested.  In  realitv 
however,  there  is  more  than  oiu’ 
w.iy  to  validly  overtravel  test 
the  rod.  I he  oomjNuter  program 
is  being  updated  to  reflect  the 
ways  the  rod  can  he  overt  r.i\ el 
t est  ed . 
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d.  In  regards  to  the  administrative 
t.r.k  ot  vaUiilating  till-  heatup 
iMti-  vorrevt  1>  , there  were  also 
some  grading  ditferenees.  Ihe 
computer  calculated  the  averagi- 
heatup  rate  over  the  exercise 
duration.  Some  of  the  operators 
however,  calcul.afed  the  instan- 
taneous heatup  rate  at  the 
exercise  termination. 

Analysis  of  SCRAM  Ixercises 

from  the  computer  printout  of  the 
performance  summary  as  compared  to 
the  instructor  evaluation,  as  shown 
in  Figure  (>  , the  major  areas  of 
grading  differences  were  in  Nuclear 
Instrumentation,  (lencrator/l  lec- 
trical,  Keactor  Water  Cleanup 
( NWt  U ) , and  Recirculation  System. 

Following  a detailed  discussion  with 
the  instructor  performing  the 
operator  evaluations,  the  following 
facts  were  apparent; 

a.  Some  of  these  SCR,\,‘I  exercises 
were  terminated  early  by  the 
instructor  simjily  because  the 
operator  had  the  plant  condi- 
tions well  under  control  and  was 
obviously  handling  this  situa- 
tion correctly.  Ihe  I’erform.ince 
evaluation  System,  however. 


required  that  the  exercise  he 
entirely  complete  for  it  to  be 
properly  evaluated. 

b.  What  seemed  to  be  a technical 
difficulty  with  the  simulator 
may  also  have  been  the  cause  for 
nuclear  instrumentation  grading 
differences.  It  was  noticed 
during  operations  that  some 
nuclear  i nst  rtiment  .it  ion  indica- 
tions were  not  functioning 
norma  1 ly . 

c.  Incomplete  familiarity  with  .ill 
of  the  items  to  be  ev.iliiated 
under  each  section  of  the  ev.il- 
uat  ion  form  also  gave  rise  to 
further  c.r.iding  discrepancies  in 
the  areas  of  the  dene r.i t or ■' 
llectrical,  KWCII,  .ind  Recircu- 
lation System  sectioti-  of  this 
SCR.Afl  exercise. 

^ . Analysis  of  the  Startup  Ixercises 

Technical  difficulties  with  the  data 
tapes  of  two  of  the  four  startup 
exercises  caused  them  to  he  incom- 
plete. Hence, only  two  startup 
exercises  were  considered  as  having 
valid  results.  In  these  two  exer- 
cises, the  same  variations  between 
the  computer  results  and  the 
evaluator  results  as  shown  in 
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l ijiiiro  / occiirrt'il  in  thn  M;iin 
lurbini-,  Main  (Jenorator,  Auxiliary 
rU'Ctrual,  Turhinp  ('ontrol. 

Heart  ivity  Power  Control,  ami 
Ceneral  Control  sections. 

The  st.irtiip  exercise  is  a difficult 
exercise,  not  only  for  the  operator 
in  training  to  perform,  but  also 
for  the  instructor  to  properly 
ev.iliiate.  The  difficulty  of  this 

р. irt  iciil.ir  exercise  is  perhaps  best 
described  by  the  operators  who 
■ictiially  participated  in  this 
program. 

four  test  subjects  evaluated  the 
Plant  Startup  operational  sequences 
for  error  potential.  The  Plant 
st.irtup  exercise  tasks  which  were 
perceived  .is  being  most  error-prone 
.ire  .IS  follows: 

a.  (hecks  Units  Auxiliary 

1 r.instornier  voltage  prior  to 
4 kV  transfer. 

b.  Maintains  transfer  voltmeter 
bal.inced  during  turbine  loading. 

с.  Selects  and  withdraws  correct 
control  rods. 

d.  Maintains  reactor  vessel  level 
between  28  and  58  inches. 

e.  Correctly  determines  the  first 
stage  bowl  temperature. 

f.  Verifies  that  chest  warming  is 
off. 

g.  \erifies  lilt  pump  on  until 

>190  RPM. 

5.1'  Concluding  Hemarks 

1.  Improvement  ot  the  Instructor's 
Capab 1 1 1 1 y 

I he  f.ict  th.it  the  computer  eval- 
. It  ion  IS  so  complete  .ind  exacting. 

It  not  only  evalu.ites  the  operator 
in  tr.iining,  hut  it  .ilso  tends  to 
me.isure  the  performance  of  the 
instructor's  evalu.it  ion  as  well. 

It  is  difficult,  if  not  impossible, 
for  the  evaluator  to  monitor  all  of 
the  p.ir.imeters  which  the  computer 

c. in  do  e.isily,  however,  with  a 
little  practice  employing  the  use 
of  the  com[iuter  printout  results, 
the  instructor  will  tend  to  hecome 
much  more  aw.ire  of  those  areas  of 
evaluation  which  he  must  concen- 
trate on  to  become  more  effective 
in  his  ev.i  I ii.it  ion  capabilities. 


2.  Videotape  Monitoring  of  the  Pilot 
2nij) I ementation  l.xercises 

It  was  also  learned  during  these 
pilot  implementation  exercises  that 
the  videotape  replay  of  the  com- 
pleted exercise  proved  invaluable. 

It  not  only  provided  a tool  to 
review  the  operational  exercises, 
but  it  also  became  a mechanism  for 
the  student  to  observe  himself  in 
act  ion . 

.5 . Research  Project  Utilizing  Impirica  I 
Data  Collected  During  ^he  Perfor- 
mance Measurement  System  lixercises 

The  types  of  exercises  best  suited 
for  research  purposes  would  most 
likely  be  equally  well  suited  for 
enhancing  training  endeavors.  The 
important  goal  in  this  regard  would 
be  to  obtain  a comprehensive  data 
base.  This  can  he  best  accomplished 
by  having  viable  exercises  on  both 
BWR  and  PWR  simulators  which 
provide  researchers  with  needed 
data  in  such  areas  as: 

• Quantitative  modeling  of 
operator  performance  and 
rel iabi 1 ity. 

• Human  factors  aspects  of  control 
room  design. 

• Man-machine  relationships  that 
would  contribute  to  the 
development  of  future  control 
board  designs. 

• Personnel  selection  research. 

4.  Project  (Continuation 

In  conclusion,  the  proposed  project 
continuation  for  implementing  the 
Performance  Measurement  System  for 
the  next  .5  years  is  divided  into 
four  tasks  as  shown  below. 

• Task  1:  Uevelop  10  Additional 
Txercises  for  the  Browns  Ferry 
BWH  Simulator 

• Iasi  2:  Uevelop  10  Performance 
Measurement  System  Ixercises 
for  a PWR  Simulator 

• lask  .5:  Adapt  Ixercises  to  a 
Second  PWR  or  BWR  Simulator 

• I'ask  4:  Conduct  Research 
Projects  lltiliiing  l.mpirical 
llata  Collected  During  the 
Performance  Measurement  System 
I xerc i ses 


35 


ABOUT  THE  AUTHORS 


OR.  ROhlALV  V.  GRAVIS  a Setuo'i  ScientiJit  at  GeneAoi  PhyiTci 
Ccif.viaTicn  ivheAn  he  fAuvideJi  iaentifiic  and  technical  iuppvrt  tc 
the  geneiat  phyna  eng<nee.Ung  ita^^  ipeciatizing  <n  itatUAticat 
and  CO mpute-T- aided  analyiii  and  deoetopment  oi  ccmputci  ptogiami 
to  6upport  nuctear  pcu/eA  ptant  operations . He  mos  a mathematician 
at  the  li.iJ.  Naoai  Uissile  Center,  a'liere  he  devetoped  mathematicat 
models  and  the  associated  computer  programs  ijoi  the  ope,rationaX 
eoatuation  the  Sparrow  Til  and  Phoenix  Hiss  He  Systems  ^or 
two  years.  He  also  an  Assistant  Processor  o^  Physics  at 
Catholic  University  and  continues  to  teach  evening  courses  in 
the  acoustics  program.  Dr.  Graves  has  a B.A.  degree  in  mathematics 
^rom  Williamette  University  and  the  H.S.  and  Ph.D.  in  physics 
^tom  University  o^  Oregon. 


HR.  CHESTER  F.  RUPIEC,  JR.  is  a Senior  Training  Specialist  at 
General  Physics  Corporation  working  with  advanced  programs  which 
relate  to  commercial  utility  programs.  He  is  a lead  investigator 
on  the  project  to  develop  an  objective  operator  performance 
method  using  the  Browns  Ferry  Huclear  Power  Plant  simulator. 

He  also  assists  in  the  preparation,  review,  and  editing  of  training 
texts,  materials,  and  programs.  For  9 years,  Wi.  Kupiec  was  a 
Senior  Training  Engineer  Westinghouse  Electric  Corporation  at 
Zion  Training  Center  where  he  directed  training  engineers  and 
instructed  in  reactor  theory  and  control,  radiation  protection, 
and  safety.  He  also  taught  courses  in  fundamentals  of  nuclear 
pwoer  generation  at  Northwestern  University  Training  Reactor  and 
produced  videotapes  on  reactor  technology.  Whale  at  the  National 
Bureau  of  Standards,  he  conducted  laboratory  experiments  in 
neutron  physics  and  solid  state  radiation  detectors.  Kupiec 

has  a B.E.E.  degree  and  an  H.S.  degree  in  nuclear  engineering 
from  Catholic  University. 


36 


SIMIH-ATOF?  COMPAKATIVF  t^VA  I.UA'IION 


1,1  COI,  III'NKY  A l<IVi:i<.S.  tISAF  and  KIKIdl  S.  VAN  AKSDAM, 
MQ  USA!'  'I'actical  Air  Warfare  Center 


INTROni'CTlON. 

lactical  Air  Command  ( I'ACl  requires 
simulation  devices  efficient  in  providing 
training  in  high-c  o st -of -t  rai  ning  areas. 

1 AC  is  currently  evaluating  simulation  de- 
vices employing  advanced  visual,  motion, 
and  Ci-cueing  subsystems  procured  to  meet 
this  requirement.  This  special  project  was 
conducted  in  order  to  establish  base-line 
information  regarding  other  simulator  sys- 
tems presently  used  in  other  government 
and  civilian  training  capacities,  and  was 
directed  verbally  by  the  Commander,  TAC. 

1 his  effort  provided  an  initial  subjective 
evaluation  of  simulator  systems  presently 
available  to  the  United  States  (government. 
Allied  air  forces,  and  airlines  and  under 
development  by  industry.  This  broad 
assessment  of  simulator  systems  and  sub- 
systems, which  represent  the  state  of  the 
art  in  aircraft  simulation,  was  conducted  to 
provide  TAC  with  the  following: 

a.  An  extensive  listing  of  current 
devices  and  associated  instructional 
features. 

b.  A detailed  description  of  each  sys- 
tem's / subsy  stem' s capabilities  and 
limitations. 

c.  A subjective  assessment  of  the 
existing  and/or  potential  ability  of  each 
system  and 'or  subsystem  to  satisfy 
tactical  air-to- surface  (A/S)  and  air-to- 
air  (A /A)  training  requirements. 

d.  Empirical  data  that  will  serve  as  an 
Important  part  of  the  basis  for  a deter- 
mination of  simulator  motion  platform 
requi  rement. 

The  Simulator  Comparative  Evaluation 
was  conducted  by  two  evaluation  teams 
(A/A  and  A/S).  The  teams  evaluated  the 
performance  of  10  devices  identified  as 
having  A /A  training  capabilities  and  ') 
devices  identified  as  having  A/S  training 
capabilities.  In  addition,  17  non-fighter- 
configured  devices  presently  used  in  govern- 
ment/civilian training  programs  or 
research  programs  and  4 developmental 


systems  were  evaluated  or  observed.  Ihese 
systems  represent  a broad  sample  of  varied 
visual  and  motion  system  combinations.  Not 
all  simulation  systems  worthy  of  TAC  exam- 
ination were  included  in  this  evaluation. 

Cither  advanced  systems  were  identified  as 
offering  unique  characteristics  and  capabili- 
ties but  were  unavailable  during  the  time  of 
this  project.  These  systems,  as  they 
become  available,  will  be  examined  in  the 
future. 

inUTPOSE  OF  THE  EVALUATION. 

The  purpose  of  this  project  was  to  sub- 
lectively  evaluate  the  capabilities  and  limi- 
tations of  current  fighter-configured  simu- 
lator systems  to  identify  features  that  could 
enhance  future  A/A  and  A/S  simulators.  In 
addition,  non-fighter-configured  operational' 
devices  and  certain  systems  in  development 
were  examined  for  features  having  potential 
application  to  tactical  simulators. 

The  purpose  was  addressed  specifically 
through  accomplishment  of  the  following  four 
objectives; 

a.  Flxamine  motion  cues  for  positive  ' 
negative  effects  and  the  enhancement  ' 
degradation  of  pilot  performance  with 
and  without  motion  platform. 

b.  Examine  the  capability  of  the  vari- 
ous visu.al  systems  to  provide  the  appro- 
priate visual  cues  and  references  to 
perform  selected  tasks. 

c.  Examine  the  capability  of  the  simu- 
lated flight  characteristics  to  enhance 
training  of  selected  tasks. 

d.  Identify  the  instructional  features 
that  will  provide  monitoring  capability 
and  control  of  specific  situational  train- 
ing task  inputs  that  enhance  training 
effectiveness. 

M ETHOO  OF  ACCOMPLISHMENT. 

In  preparation  for  the  evaluation,  a list 
of  candidate  simulators  was  screened  by 
USAF  Tactical  Air  Warfare  Center  (USAFTAWC), 
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TAC,  anti  Aeronautical  Systems  Division 
(ASDI  personnel.  Some  of  the  candidate 
tievices  were  removed  from  consideration 
because  of  their  similarity  to  other  systems 
beinv:  evaluated,  nona va  i l.ibi  1 ity  during  the 
ev.iluation  period  liue  to  modification  efforts 
or  training  schedules,  or  incomplete  instal- 
lation. Air  attaches  in  England,  France, 
and  (iermany  were  requested  to  recommend 
simulators  in  those  countries  that  would  be 
candidates  for  this  evaluation  effort.  Only 
five  foreign  devices,  all  of  which  were  in 
Fngland,  were  recommended  for  evaluation. 
Two  of  these  were  developmental  systems 
in  industry,  and  throe  were  training  devices 
employed  by  the  Iloyal  Air  Force  (RAF). 

The  candidate  list  of  devices  to  be  evaluated 
was  categorir.ed  into  groups  of  functionally 
common  units  or  classes.  The  categories 
were  (1)  operational  fighter-configured 
training  devices,  (2)  operational  non- 
fighter-configured training  devices,  and  (3) 
engineering  developmental  systems. 

Following  is  a list  of  the  devices  that  were 
evaluated  or  observed.  The  list  is  organ- 
ized by  category. 

Fighter-Configured  Devices, 

F-14  (NAS  Miramar,  California) 

'rA-4.T  (NAS  Chase  Field,  Texas) 

Tornado  Multirole  Combat  Aircraft 
(MRCA)  (Warton,  United  Kingdom)* 
Jaguar  (Coltishall,  United  Kingdom) 
Simulator  for  air-to-air  combat  (SAAC) 
Luke  AFB,  Arizona) 

Large-amplitude  multimode  aerospace 
research  simulator  (LAMARS) 

( W r ight- I'atte r son  A F 13,  Ohio) 

La  rgc -amplitude  system  / wide-angle 
visual)  simulator  (LAS/WAVS) 
(Northrop  Corp,  Hawthorne,  Cali- 
fornia ) 

Large-amplitude  motion  base  simulator 
(1,AMI3S)  (LTV,  Grand  Prairie, 
Texas)** 

Vought  air  combat  simulator  (VACS) 
(LTV,  Grand  F’rairie,  Texas) 

Motion  base  system  (MBS)  (McDonnell 
Douglas  Corp,  .St  Louis,  Missouri) 
Manned  air  combat  simulator  (MACS) 

1/11  (McDonnell  Douglas  Corp,  .St  Louis. 
Missouri) 

MACS  III  (McDonnell  Douglas  Corp, 

St  Louis,  Missouri) 

Advanced  simulator  for  pilot  training 
(ASPT)  (Williams  AFB,  Arizona) 
Differential  maneuvering  simulator 


(DMS)  FTR  (NASA  Langley  AFB, 
Virginia) 

F-4  (ItAF  Conlngsbv,  I nlted 
K i ngdom ) 

Buccaneer  (RAF  llonington.  United 
Kingdom) 

A-7D  ( Davis- Monthan  AFB,  Arizona)* 

Non- F ight  er- Confi  gured  1 )evi  ce  s . 

Boeing,  Compuscene  Visual  (.Seattle, 

W a shington) 

Boeing  707  ( Link- M iles.  Lancing, 
United  Kingdom) 

Redifon  DC- 10  (Crawley,  United  King- 
dom) 

American  Airlines  727,  Novoview 
Visual  (Dallas.  Texas) 

American  Airl ines  DC- I 0,  Redifon 
Visual  (Dallas,  Texas) 

United  737,  Novoview  Visual  (Denver, 
Colorado) 

TWA  707  VI/cal  111  Visual  (Kansas 
City,  Missouri)* 

Northwest  7X7  Link  Mark  V Visual 
(Minneapolis,  Minnesota)* 

Flying  Tiger  DC-8,  VITAL.  11  Visual 
(Los  Angeles,  California) 

FSI  DC- 10,  VITAI.  11  Visual  (Long 
Beach,  California) 

Southern  Airlines  DC-9  night  visual 
system  (NVS)  (Atlanta,  Georgia) 
Braniff  727,  Duoview  (Dallas,  Tc-xas) 
Braniff  DC-8,  Novoview  (Dallas, 

T exas I 

Continental  Airlines,  Novoview  1 1 
(Los  Angeles,  California) 

NASA  AMF.S  (FSAA)  Redifon  Visual, 
Moffett  NA.S,  California 
NA.SA  737  (Langley  AFB,  Virginia) 
C-135,  .Singer  NVS  (W  right-Patterson 
AFB,  Ohio) 

USN  SlI  2F,  IJVMPS  (NAS  Norfolk, 
Virginia) 

.S-61  Helicopter  (NASA  Langley  AFB. 
Virginia) 

U.SN.S-3A.  VITAL  111  (NAS  Cecil 
Field,  Florida) 

USN  P-3C  Duoview  (NA.S  Moffett  Field, 
California) 


Developmer 


ems. 


T-37/38  instructional  flight  simulator 
(Singer,  Binghampton,  New  York) 

*Not  fully  evaluated:  demonstration  only. 

♦ * Fvaluated  for  motion  simulation  only. 


I, ink  N\S  (SinKPr,  Sunnyvale,  Cali- 
fornia I 

Calligraphic  Hi^ital  image  generation 
(CIMCi  or  IMCiSi  Sing»-r,  Sunnyval*-, 

Ca  1 ifornia  I 

rSAK  TAWC  n’NA  TNS  personnel 
examinerl  and  listed  operational  tasks  to  he 
performed  during  the  evaluation  missions  in 
fighter-  and  non- fight e r-configu red  simu- 
lators. Because  of  the  limited  access  and 
time  available,  no  more  than  four  evaluation 
missions  per  pilot  could  be  flown  on  each 
f ight e r- conf i gured  device  and  one  mission 
per  pilot  on  non-fighter  simulators.  There- 
fore, the  emphasis  was  not  placed  on  devel- 
oping a complete  list  of  operational  A A and 
A 'S  tasks,  but  rather  an  abbreviated  list 
that  was  representative  of  tasks  performed 
in  A 'A  and  A 'S  training.  Twenty-four  A 'A 
tasks  were  selected  and  grouped  appropri- 
ately into  four  sorties.  The  first  mission 
consisted  primarily  of  transition /formation 
tasks;  the  second  and  third  missions 
included  basic  fighter-maneuvers  (BKM), 
and  the  fourth  mission  aiidressed  advanced 
air  combat  maneuvers  (ACM).  Twenty- 
eight  A '.S  tasks  were  selected  and  organized 
into  four  evaluation  sorties.  The  first  mis- 
sion primarily  included  transition  maneu- 
vers; the  last  three  addressed  tasks  that 
included  progressively  more  difficult  ground 
attack  events,  complicated  by  weather 
restrictions  when  available,  kiach  sortie' 
mission  was  designed  to  be  accomplished  in 
one  hour  or  less.  The  missions  were  designed 
to  m.iximize  the  opportunity  for  evaluation 
pilots  to  accomplish  their  subjective  assess- 
ment of  the  capability  of  each  training 
device  and  its  instructional  features.  The 
non-fighter-configured  simulators  were 
examined  by  the  evaluation  pilots  during 
only  one  mission.  Ihe  tasks  performed  in 
the  single  evaluation  mission  included  transi- 
tion, instruments,  and  examination  of 
limited  visual  fieltl  of  view  I KOV 1 applica- 
tion to  weapon  delivery. 

In  the  development  of  the  questionnaires, 
the  four  objectives  that  had  been  defined  in 
the  evaluation  plan  were  found  to  be  inade- 
quate in  categorizing  all  of  the  areas  to  be 
examined.  Some  cues  to  be  examined  were 
not  clearly  identifiable  with  any  one  of  the 
four  objectives;  therefore,  the  questionnaires 
and  the  evaluation  approach  were  structured 
around  the  following  features; 


Motion  simulation 
Visual  cues 

Target  image  (A 'A  only) 

Flight  characteristics 

Sound  cues 

Special  »-ffects 

Physiological  effects 

Inst  ructional  features / consoles 

Overall  training  capability 

Kach  evaluation  team  consisted  of  a 
nrotect  officer,  tViree  TAC  fighter  pilots  as 
evaluation  pilots,  one  briefing  officer 
(pi lot-qual if ledt,  one  operations  analyst,  and 
an  Air  Force  simulator  technician.  In 
addition,  an  ASI)  engineer  accompanied  the 
team  to  sites  possessing  a training  device 
for  which  ASP  did  not  have  full  descriptions. 
Basically,  the  responsibilities  of  the  team 
members  were  as  follows: 

a.  Project  Officer.  Fach  nroiect 
officer  was  responsible  for  on-site 
evaluation  management  and  conduct 
of  the  evaluation  of  each  device. 

b.  Fvaluation  I^ilots.  The  evaluation 
pilots  were  responsible  for  a subjec- 
tive evaluation  of  the  visual  system, 
motion  system,  instructional  features, 
and  flight  characteristics  of  each  device 
evaluated. 

c.  Briefing  Officer.  The  briefing 
officer  was  responsible  for  the  detailed 
br lef  1 ng /debr iefi ng  of  each  evaluation 
mission  and  for  ensuring  that  a complete 
and  detailed  account  was  obtained  from 
each  evaluation  pilot.  The  briefing 
officer  also  acted  as  the  assistant 
project  officer. 

il.  Operations  Analyst.  The  operations 
analyst  was  responsible  for  ensuring 
that  sufficient  data  were  collected  to 
satisfy  the  objectives  of  the  evaluation 
and  for  processing  the  data  in  a manner 
that  permitted  expeditious  analysis. 

e.  A.SI)  Kngineer.  The  ASD  member 
was  responsible  for  assessing  each  sys- 
tem's potential  for  engineering  design 
advancements  or  improvements. 

f.  Simulator  Technician.  The  simu- 
lator technician  was  responsible  for 
developing  a complete,  detailed  tech- 
nical description  of  the  system  and 
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suhsystftns  ass«*HS€*d  fJurinn  thf  fvalu- 

ation. 

rh»'  pr()C*‘durf*s  usfH  fc)r  svHtc'ms  evalu- 
ation were  as  fnllt»ws: 

The  p)r(»j»*ct  officer  pr*‘CrdeH  the 
rf-rnainin^i  ineiTihers  <)f  tlu*  evaluation  tearo 
in  ‘'r^N'r  to  obtain  sufficient  information  to 
become  familiar  with  the  simulator's 
characteristics  and  operation.  He  then  pre- 
pared a di-tailed  briefmy  on  the  facility, 
which  was  ^iiven  to  th«‘  evaluation  team  and 
c(»ortiinatefl  with  site  pers(;nn<*l  to  ensure 
that  the  simulator  was  properly  configured 
for  th<*  evaluation. 

1 he  evaluation  team  members,  upon 
arrival  at  the  test  site,  were  briefed  by  the 
proiect  officer  and  provifled  with  a familiar- 
ization tour  of  the  facility.  Whenever 
possible,  the  pilots  were  yiven  an  introduc- 
tory orientation  period  in  the  flight  simula- 
tor pri(jr  to  flyin^i  the  first  mission.  In 
most  cases,  the  evaluation  pilots  were  not 
qu<ilified  in  the  type  of  aircraft  the  simulator 
represented;  however,  they  were  all  fi^hter- 
aircraft  qualified,  and  reviewed  the  flight 
characteristics  with  qualified  pik/ts  prior 
to  flying  the  simulator.  All  team  members 
attended  the  premission  briefing  in  which 
the  briefing:  officer  and  operations  analyst 
reviewed  the  requirements  of  data  collec- 
tion and  the  unique  features  of  the  device  tt) 
be  evaluated. 

The  project  officer,  briefinj^ /debr i ef- 
inji  officer,  and  operations  analyst  moni- 
tored the  mission.  The  briefin^^  offic«*r  an(l 
analyst  exercised  the  instructional  features 
and  noted  pilot  comments  during  the  course 
of  the  mission.  1 he  project  officer  ensured 
that  the  simulator  technician  had  access  to 
the  necessary  data  and  appropriate  person- 
nel to  obtain  sufficient  system  descriptions. 

After  completing  each  mission,  the 
evaluation  pilots  completed  their  ratings 
and  comments  of  the  mission  on  the  task 
questionnaire.  All  debriefing  forms  were 
reviewefl  by  the  debriefing  officer  and  oper- 
ations analyst  for  completeness. 

A final  debriefing  was  held  at  the  con- 
clusion of  each  system  evaluation.  All 
evaluation  team  members  attended  the 
debriefing,  and  every  aspect  of  the  system 
evaluation  was  addressed,  A tape  record- 
ing was  made  of  the  debriefing. 


SPMMAHY  (;F  H_KSrLTS. 

I he  consensus  was  that  current  plat- 
form ancl  b»'am  motion  systems  evaluaterl  do 
not  provifle  eff#Ttive  (u^  s or  enhance  real- 
ism for  the  oerformanc#'  of  A A or  A S 
t.isl<s  and  enhance  realism  only  in  lim.ted 
areas  of  transition  maneuvers,  I’he  evalua- 
tion pilots  felt  that  a sophisticated  motion 
platffirm  system  is  not  r«*quired  for  tactical 
fighter  training  (N'vices,  C'ue.s  such  as  tur- 
bulence or  runway  feel  were  significant  aids 
during  instrument  and  transition  tasks.  Of 
tlu*  fighter-configured  simulators,  th<-  sinui- 
lator  for  air-to-air  combat  fSAAC),  large- 
amplitude  multimode  aerospace*  research 
simulator  (l.AMAHS).  and  laguar  motion 
systems  provide-d  the  most  realistic  cues 
for  transition  training:  th**  differe  ntial 
maneuvering  simulator  (DMS)  exhibited  the- 
most  realistic  buffet  system. 

The  evaluation  pilots  estimaterd  that  the' 
majority  of  all  realistic  motion  sensations 
resulted  from  cues  provided  by  effective 
visual  systems.  The  computer- gene  rated 
image  (CGI)  visual  systems  of  the  advance*d 
simulator  for  pilot  training  (ASPT),  7 A-4  1. 
and  most  airline  simulators  provide'd  the 
most  effective*  visual  stimuli  for  altitude 
change,  acceUtration 'deceleration,  and 
rate  and  direction  of  turns.  Simulators 
using  dome  projection  systems,  while  pro- 
viding good  pitch  and  roll  reference's,  were 
less  effective  because  of  their  apparent 
fixed  position  over  the  earth’s  surface. 

l^oth  evaluatiou  teams  agre<‘d  that  an 
effective  visual  system,  enhanced  by  opti- 
mized G-suit.  Ci-seat,  and  buffet  systems, 
would  provide-  adequate  cues  for  the  per- 
formance of  A A and  A S tasks  and  these 
are  requirctd  f«*atures  for  future  fighter 
simulate  r s. 

Of  the  A /S  systems  evalaat<*d,  only 
CGI  systems  afforded  the*  clarity  and  r»*so- 
lution  nece-ssary  to  recognize  an<l  identify 
objects  at  normal  slant  ranges. 

Color  prov€?d  to  be  an  important  factor 
for  nc)rmal  object  recognition  and  identifi- 
cation in  A/S  training  devices. 

Small  gaming  areas  increased  the  diffi- 
culty of  performing  A/S  tasks  by  causing 
the  pilots  to  expend  inordinate  effort  to  re- 
main in  the  environment.  Clarity,  resolu- 
tion, and  gaming  areas  were  generally 
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iiiaiicqiiatr  in  .ill  tatiu- ra 'ino<l<'l  hoartl 
visual  systems. 

Niirmal  techniques  ariH  procedures 
could  he  j'mployed  only  in  simul.itors  that 
duplicat»-d  the  field  of  view  of  the  aircraft. 

The  evaluation  pilots  concluded  that 
unrealistic  performance,  size,  and  display 
of  t.ir^ret  aircraft  degriide  air  combat  train- 
ing and  that  target  ima^'es  must  allow  deter- 
mination of  aspect  angle,  range,  and  clo- 
sure .at  near- realistic  ranges. 

Simulator  handling  characteristics/ 
flight  performance  that  was  not  representa- 
tive of  the  simulated  aircraft  detracted  from 
the  overall  credibility  of  the  simulator  and 
represented  a potential  for  negative  train- 
ing. Total  fid«-lity  throughout  the  flight 
envelope  was  not  achieved  by  any  of  the 
devices  evaluated;  however,  the  DMS  was 
rated  as  Vieing  faithful  to  the  airplane's 
performance  in  most  instances. 

Cockpit  weapon  panels,  switches,  gun- 
sights,  or  heads-up  displays  that  are  not 
identical  to  those  of  the  aircraft  being  simu- 
lated and  the  lack  of  realistic  integration  of 
the  complete  weapon  system  detract  from 
the  credibility  of  the  simulator  and  degrade 
training  potential.  Full  weapon  system 
integration  was  best  demonstrated  by  the 
manned  air  combat  simulator  (MACS). 

Special  effects  for  A /A  training,  such 
as  missile  launch  and  impact  indications 
and  attacker's  gun  flash,  were  best  demon- 
strated in  the  .MACS.  .Special  effects  for 
A/S  training,  such  as  weapon  impact  indi- 
cations and  moving  targets,  were  best 
demonstrated  in  the  ASPT.  Special  effects 
for  ceiling  and  visibility  conditions  in  air- 
line devices  were  better  than  in  fighter- 
configured  devices,  Effective  sound  cues 
contributed  to  overall  realism  of  missile 
launch  and  gun  firing. 

Of  all  the  A/A  devices  evaluated,  only 
the  combined  MACS  I,  11,  and  111  systems 
demonstrated  an  interactive  two-versus- 
one  training  capability.  The  evaluation 
pilots  described  this  capability  as  being  the 
rtiost  important  requirement  in  future  A/A 
simulation  training. 

None  of  the  A /A  systems  evaluated 
featured  console  arrangements  optimized 
to  provide  the  instructor  with  adequate 


monitfiring  and  control  capabilities.  The 
A ’'S  systems  having  the  b»’Sf  capability  for 
instructor  monitoring  wo  re  fhe  ASPT  and 
rA-4  1.  Weapon  scoring,  aircraft  para- 
meter readout,  and  record ' playback  capa- 
bility (in  th»'  ASPT)  contributed  greatly  to 
tiu'  instructional  capabilities  of  these  sys- 
t ems . 

Several  of  the  airline  training  devices 
were  considered  outstanding  in  the  areas  of 
takeoff,  approach,  and  landing.  Features 
that  wo're  particularly  effective  in  airline 
systems  included  excellent  resolution  and 
clarity  of  the  visual  scene;  realistic  night/ 
dusk  environment,  which  included  horizon 
glow,  moon,  stars,  and  effective  use  of 
light  points  to  represent  the  surrounding 
area;  and  excellent  airport  environment, 
which  featured  correct  color  for  flashing  and 
steady  lights,  runway  texturing,  runway 
detail,  and  landing  lights.  Additionally, 
some  of  these  simulators  have  motion  plat- 
forms optimized  to  provide  takeoff  and  land- 
ing roll  cues,  runway  feel,  and  effective 
acceleration  and  deceleration  cues. 

RFICOMMFNDAT IONS.  The  following  recom- 
mendations pertain  to  the  requirements  for 
future  fighter  simulators  as  determi.ned  by 
the  evaluation  pilots.  The  overriding 
consideration  in  making  these  recommenda- 
tions was  th«'  enhancement  of  training  capa- 
bility. It  is  recognized  that  duplication  of 
aircraft  characteristics  is  impractical,  if 
not  impossible.  For  the  areas  addressed, 
the  evaluation  pilots  felt  that  the  actions 
indicated  are  necessary  to  prevent  negative 
training. 

Moth  A / A and  A /S  simulators  should 
include  the  following: 

G-seat,  G-suit,  and  buffet  systems 
optimized  to  provide  accel  erat  i on /decel  era - 
tion  cues,  zero-  and  sustained-G  cues, 
buffet  cues,  and  on-runway  cues  for  systems 
that  include  takeoff  and  landing  capabilities. 

Visual  presentations  with  sufficient  con- 
tent and  detail  to  allow  pilots  to  determine 
airspeed,  altitude,  and  area  orientation  as 
they  would  in  the  aircraft. 

Visual  presentations  that  provide  real- 
istic grayout /blackout  cues. 

A sun  image  in  all  tactical  fighter  simu- 
lators. 


An  FOV  that  effectively  duplicates  that 
of  the  aircraft  beinfj  simulated. 

Correct  simulation  of  the  weapon  sys- 
tems complement,  including  aircraft  radar 
.»nd  l.COSS. 

Realistic  simulation  of  aircraft  flight 
performance  throughout  the  fli(!;ht  envelope. 

Realistic  indications  of  weapon  launch 
or  release  and  end-^ame  scoring  (weapon 
impact  point  or  missile  hit/miss). 

Appropriate  sound  cues  for  aircraft 
and  weapons. 

Instructional  console  features  that 
include  the  following: 

a.  A three-dimensional  view  of  the 
engagement / event. 

h.  [lisplay  of  the  pilot's  view. 

c.  Repeated  display  of  the  I.OOSS  or 
HUD  reference  system. 

d.  Accurate  weapon  scoring  and  re- 
lease parameters  available  in  real-time 
and  hard  copy. 

Ability  to  insert  malfunctions  and 
vary  ceiling,  visibility,  and  runway 
conditions  rating  for  systems  that 
include  takeoff/landing  training. 

f.  Voice  and  video  record  and  off-line 
playback  capability. 

A / A simulators  should  include  the 
following: 

Interactive  cockpits  with  2VI  capability 
with  dissimilar  aircraft. 


Parget  performance  and  display  that 
replicate,  as  nearly  as  possible,  the  air- 
craft represented. 

Target  portrayals  of  aircraft  represent- 
ing major  threat  categories. 

Parget  image  clarity,  resolution,  size, 
and  detail  that  permit  determination  of 
aspect  angle,  range,  and  range  rate  at  real- 
istic distances. 

Accurate  simulation  of  fi ght  e r 'ad  ve r sa ry 
weapon  firing  envelopes  and  probability  of 
kill. 

Visual  display  with  sufficient  clarity, 
detail,  and  color  for  target  acquisition  and 
identification  at  normal  / realistic  distances. 

An  Iron  Pilot  (computer  cont  rol led  targot 
im.igel  mode  which  utilizes  realistic  tactics, 
including  Soviet  defensive  tactics. 

Scheduling  of  training  sorties  to  a maxi- 
mum of  45  minutes. 

A/S  simulators  should  prov i de  the 
fol  lowing: 

Simultaneous  displays  of  multiple  mov- 
ing models  such  as  SAMs.  AAA.  tanks,  and 
trucks. 

A realistic  runway  environment. 

Controlled  ceiling  and  visibility  condi- 
tions and  realistic  breakout. 

Gaming  areas  adequate  in  size  to  permit 
A 'S  tasks  to  be  accomplished  with  normal 
procedures. 

Realistic  color  depiction. 
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INTKOIU'CTION 

riu'  proMrms  i»!  doiinim':.  dosipninR,  .iiul 
dfvi*li>pinp  lli^lH  training,  simulators  ami 
<'tlu‘r  svnthi'tii  ^ronml- f ra  i ri  i np  (lt*vi<ms  ar<> 
tar  fXCi*»’<i<*«l  hv  tho  prc^Mi-ms  oiu mm i ort-d  in 
t In- i r ft  ff*  t ivf  ust*.  Tlu*ir  .acrt'pt  amm  with- 
out pain  hv  t ho  ontiro  aviatii>n  training;  and 
oprratinp.  romnnin  i t i t*s  *loponds  n«5t  (*nlv  upon 
tlu-  furthor  domi>nsf  rat  ion  that  tliov  do  work, 
hut  also  that  t hcv  <Mn  bo  inti-trratod  into  a 
irainlnp  program  ro.is('nal)  1 v and  painlessly. 
Indood,  .t  can  and  must  be  shown  convincingly 
that  ih«*v  aro  tlu-  kov  to  lovols  of  opor.it  ional 
o t t o<  I Ivonoss  not  at  t .a  i n.ib  I o in  tr. lining  .lir- 
oratt  at  .inv  priio.  oxpi>suro  to  personal 
ha/.ird,  or  potent  i.al  o<)ulpmont  loss. 

r<'  <h)  this,  it  will  be  necessary  to  sell 
"The  lov  «>f  Flving  Simulators"  that  aro 
dofinod  and  designed  to  te.'ieh  ami  are  not 
meri-lv  the  products  of  the  unlettered  imag- 
itMiions  .iml  budgets  of  simulator  di-sign 
«-ng  i ru-e  rs  and  marketing  managers.  I he  pi. ice 
l-T  unti'tlered  imaginations  .and  budgets  is  in 
til*  deveh'pmont  <jf  n<*w  i nst  rue  t ion.i  1 teih- 
nologies  b.ised  upon  th<  use  of  di'Vices  of 
unprer<'dont  ed  flexibility  <it  programing  and 
rili.ibilitv  (»f  oper.it  ion.  F.xpir  iment  s reeent- 
Iv  I'omiileted  at  the  Tniversity  of  Illinois 
tor  the  Air  Koree  Oil  ice  of  Scientifii 
Kese.irch  h.ave  ilemonst  rateii  llu*  economic  and 
tutnri.il  benefits  of  two  innovative  instruc- 
tion.il  t «M  hnol ogi es , interactive  computer- 
assisted  procedural  training  .ind  aiitom.it  le.i  1 ly 
adaptive  vistj.il  cue  enhancement  in  the  devel- 
opment ot  cont.iit  l.inding  skills. 

C’nMI’FTFK-ASSISTKD  PR()CKI)I:KAL  TRAIN  INC 

CratJuate  stiuleni  lami's  P.  Finnegan,  super- 
vised hv  I)r . Mii  h.iel  T.  Kellv,  measureil  the 
fr.insfiT  of  tr. lining  of  private  pilots  of 
limlteil  Instrument  experience  in  living  hold- 
ing p.itterns  Ifi  varying  wind  conditions  1 nmi 
the  Pl.ATO  computer-based  instructional  system 
to  the  Piper  Arrttw  .airplane.  Finnegan's  CAI 
"s  Imu  1.1 1 or  , " originally  devc'loped  by  gr.aduate 
student  Stanley  R.  TroMIp  (1977),  .allows  the 
student  t(»  "fiv"  a simulated  airplane  using  a 
hand  eonirol  with  refi-rence  to  dynamic  Instru- 
ment Indh.itlons  drawn  by  tlu'  computer  on  a 
p 1 asnui-iTui t r 1 x display  screen. 

Finnegan  (1977)  divided  his  48  suhiects 
Into  three  equal  groups  who  received  the 
following  training  Hequences:  (1)  CAI,  then 


.aircraft;  (2)  ground  school,  CAT-2,  then  air- 
craft; ( J)  ground  school,  then  .airiraft  only, 

.as  a control  basis  for  measuring  transfer. 

CAI  training  pn>ved  comparahh*  in  tr.ansfer 
ef  feet  1 v«*ness  to  the  analogous  instruct  i«>n  in 
a SInger-l.ink  CAT-2  general  aviation  trainer. 

In  both  cases  there  was  rt‘liahle  pf>sitive 
transfer,  but  at  a big  difference  In  cost, 
the  iiit  er.ac t i ve  PIJVTC  "simulator"  being  higlily 
cost  effective  .and  the  CAT-2  not  being  cost 
effective  in  this  particular  application. 

The  appl irahi 1 1 tv  of  CAI  training,  not  only 
in  flight  procedures  but  also  across  the 
range  of  cognitive  learning  currently  covered 
in  ground  school,  w.arrants  serif>us  consldera- 
1 1 on . 

ADAPTIVF  PFRCKPirAI-MOTCR  TRAININC 

(Tiv.an  Lintern  ( 1977),  under  ray  supervi- 
sion, developed  .and  demonstrated  the  transfer 
effectiveness  of  the  substitution  of  auLi^- 
rruitic  presentation  .ind  withdrawal  of  guidance 
cues  ill  a simple  skeletal  computer-generated 
visual  landing  system  in  lieu  of  the  verbal 
.and  manual  assistance  norra.illv  provided  bv 
the  flight  Instructor  during  Initial  l.inding 
training.  I. intern  trained  48  flight-naive 
subjects  to  criterion  landing  perfornuinces  in 
the  Singer-Mnk  CAT-2  without  cockpit  motion. 
(Groups  of  12  students  each  were  trained  under 
each  of  the  following  four  conditions. 

Control  (iroup;  All  training  by  reference 
to  a closed-loop,  computer-generated  skeletal 
airport  scene  consisting  ot  .i  horizon,  ninwav 
outline  .and  centerline,  and  an  aimpolnt  500 
feet  t roni  threshold,  all  TA’-pro ) ec  t ed  onto  a 
spher  1 c.a  1-sei- 1 Ion  screen  mounted  in  front  of 
I he  pi  lot ' s coc kpl t . 

' 1 nuoiis  Augment  at  Ion  Croup  : P r e t r a i n- 
ing  by  reference  to  the  same  scene  plus  a 
visible  repreH»*ntat  Ion  of  a desired  flight 
path  for  the  fln.il  a|>pr(nich,  an  extension  of 
the  runway  centerline,  and  flare  cues  represent- 
ed by  inverted  L-markers  placed  along  either 
side  ot  the  runw.iv  starting  2,000  feet  from 
threshold . 

Adapt  1 ve  Augmentation  Croup;  Pretraining 
by  reference  to  the  same  augmented  visual 
scene,  with  the  exception  that  all  augmented 
guidance  cues  were  autonuit  ical  ly  withdrawn 
whenever  the  simulated  airplane  was  within 
specified  tolerances  relative  to  the  desired 
fllglit  path,  thereby  weaning  the  students  of 


t]u‘  nonrcal  WiirWl  ass  i st  ancf  c*<im!ort 

( lu‘V  <1  { i . 

Tr.iasl»'r  Ciuitrol  <irovip:  An  rf|u.i  1 .imntnit 
ot  prrf  rai  n i n>:  hv  rrt  <*r*-n<»‘  !i*  ,i  projn  f »•<! 
\rnss  i fprrstMil  i 11)’  f lu'  airplanf’s  .n  l na  1 
tlik^ht  path  ami  a proir.  tiui  sqnan*  rnprnsmU- 
iiH’.  ti\i‘  lii'siinl  t 1 iv'lit  path,  t}u*r*‘bv  in-atinp, 
a taimpt-nsa  t oi  V tracking,  task  and  <-on  t rc»  1 M 
tor  t lu*  piwsihl*-  transtn  td'  Irarninp,  assot  i- 
alocl  »iniq«u-lv  with  prai  iiit*  in  ( anu ro  1 I i n>; 
th<‘  s lmiilaf<’r, 

thfir  prot  ra  i ni  np, , c.u-h  of  t lu* 
thri‘f  iransfor  prmips  ront  inurd  Irainlnp  i 
criterion  pt-rf ormanoo  Icvois  undc*r  tlu*  control 
condition.  All  siiidcnts  in  -ill  groups  reached 
the  criterion  t>f  threi*  successive  landings 
witfiin  pri'estah  lisfied  t(' i er.inc  es , .in(f  tfie 
tr.insfer  effectiveness  of  the  three  experi- 
mental pretraininp  strategies  was  In  the  pre- 
dicted (>rder:  The*  xroiij.  with  automatically 
.idapt  ive  augmented  visual  feedback  reached 
criterit'n  most  quirklv;  the  proup  with  con- 
tinuous augmentation  durlnp,  pretraininp  wa  ; 
next;  and  the  proup  that  practiceii  makinK 
approai hes  without  benefit  of  anv  representa- 
tion of  a dynamic  airport  scene  showed  little 
transfer,  if  any. 

One  subjeit  from  each  of  the  four  groups 
was  piven  one  pr eexper imen ta 1 flight  in  a 
Piper  Arr*)w  during  whlcii  he  was  allowed  to 
attempt  six  -approaches  and  landings.  Of  the 
total  of  2^  attempts,  none  was  successful;  In 
all  cases  the  instructi>r  iiad  to  take  over  con- 
trol. Subsequent  to  the  simulator  training^ 

21  students  drawn  randomly  from  the  rem-alning 
44,  In  approximately  equal  numbers  from  the 
four  groups,  were  similarly  tested  in  flight, 
and  29  of  the  12b  attempted  landings,  an 
average  of  1 . 18  per  student,  were  made  without 
assistance  from  the  instructor  and  without  anv 
previous  flight  experience. 


coNri.c::  !oNS 

It  is  i-vident  that  continued  training  t(> 
.1  irilerion  (d  thret-  suci-essive  unassiste<l 
I.indings  in  tlie  airplam-  hv  students  previ- 
c>uslv  trained  to  criterion  satelv  -nid  pain- 
lessly in  .1  relativolv  inexpensive  simulator 
with  a simple  visu-il  system  would  result  in 
extrenu  Iv  liigii  tr.insler  of  [)ur(  »*pt  u.i  1 motor 
skills  reqtjiri'd  In  contait  1 light.  Kurther- 
niofe,  it  appears  that  more  can  b**  gained  bv 
i mag  1 na t i ve , inexpensive,  -ind  enjov.jble 
instructional  strategies,  such  as  autom.iti- 
cally  adaptive  cue  enhancement  and  periorm- 
aiu  e teedb.ick,  tb.in  c.in  be  gained  by  any 
investment  in  visual  systems  of  high  literal 
image  fidelity.  Simil.arly,  the  applic-ition 
of  computer-assistance  to  procedural  train- 
ing, regfj /.atorv  currency,  and  Cfjgnitivt* 
refreshment  is  cost  i-f feet  ive  and  more  fun 
than  ground  school. 
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SUMMARY 

The  platform  motion  system  has  been  the 
principal  motion  and  force  simulation  device 
in  the  past  and  over  the  last  five  years  the 
C-seat,  G-sult,  and  scat  shaker  systems  have 
become  a part  of  several  of  the  Air  Force's 
simulators.  This  paper  presents  the  back- 
ground behind  the  development  of  these  devices 
and  a discussion  of  current  and  future  non- 
vlsual  system  motion  and  force  developments. 

The  challenge  of  providing  high  acceleration 
cues  for  the  tactical  aircraft  simulator 
pilot  is  presented  by  first,  looking  at  the 
need  for  high-G  simulation  and  second,  look- 
ing at  the  current  development  of  an  advanced 
C-culng  system,  hlgh-G  augm*>ntat  ion  devices, 
and  bionic  means  for  controlling  simulator 
visual  displays. 

INTRODUCTION 

A considerable  body  of  literature  exists 
concerning  the  physiological  responses  of 
humans  exposed  to  high  linear  accelerations. 
The  emphasis  in  imich  of  this  earlier  work,  as 
reviewed  by  Fraser  fl),  Roth  (21,  Gillies  (3), 
and  McFlhaney  et  al.  (41,  Is  on  the  protective 
measures  required  to  permit  subjects  to  sur- 
vive transient  or  sustained  high  acceleration 
stimuli  and,  if  possible,  to  continue  per- 
forming as  pilots.  The  impact  acceleration 
studies  have  concentrated  on  the  biomechanical 
responses  and  have  led  to  the  development  of  a 
variety  of  safet"  mechanisms.  Similarly,  the 
long  r/urallon  acceleration  problem  has  concen- 
trated on  the  cardiovascular  effects  and  has 
led  to  the  development  of  several  G-protectlve 
devices,  mo  it  notably  the  ant  1 -C  suit  to  pie- 
vent  pooling  of  blood  In  the  lower  thorax  and 
legs.  Research  facilities  used  for  these 
studies  have  typically  been  the  sbsker  or  de- 
celeration sled  for  brief  duration  studies, 
and  the  centrifuge  for  long  duration  studies. 
The  centrifuge  has  been  used  as  a way  of 
exposing  research  subjects  and  pilots  expected 
to  undergo  sustained  long  duration  hlgh-G 


forces  (such  as  astronauts  preparing  for  re- 
entry) . 

As  a simulation  tool  for  training  of 
pilots  in  practical  aircraft,  however,  the 
centrifuge  has  obvious  limitations  because  of 
the  development  of  very  strong  erroneous  cross- 
coupled  angular  acceleration  and  Coriolis  cues 
during  rapid  maneuvering,  as  well  as  the  eco- 
nomical impact  of  their  regular  use.  Conse- 
quently, there  exists  a clear  need  with  the 
development  of  newer  tactical  aircraft  which 
will  develop  higher  0-forces  to  find  some  way 
of  simulating  at  least  some  of  the  effects  of 
these  forces  on  the  pilot  in  order  to  assist 
in  both  the  validity  of  the  training  and  prep- 
aration for  actual  experience  in  flight. 

The  principal  physiological  system  re- 
sponses to  plus-G  (eyeballs  down)  sustained 
acceleration  arc  attributable  to  biomechanical 
affects  on  the  skeletal  system  and  cardio- 
vascular responses.  The  well-known  cardio- 
vascular responses  are  attributable  to  the 
hydromechanical  forces  on  the  circulation, 
which  produces  a relative  pressure  drop 
in  the  circulation  varying  with  height  above 
the  heart.  The  consequences  are  a gradual 
draining  of  blood  from  the  cerebral  circula- 
tion and  the  upper  body,  and  a pooling  of 
blood  in  the  abdominal  region  and  In  the  legs. 
Tlie  most  prominent  and  well-known  sensory 
effects  are  the  visual  ones,  in  which  a 
gradual  narrowing  of  the  visual  field  occurs 
as  delivery  of  oxygen  to  the  retinal  circu- 
lation of  the  periphery  is  reduced,  resulting 
in  an  Increasing  tunnel  vision  and  finally 
complete  blackout  wiilch  imiy  eventually  be 
followed  by  unconsciousness.  The  related 
cardiovascular  responses  are  associated  with 
the  compensatory  mechanisms  In  the  system, 
adjusting  cardiac  output  and  heart  rate  to  the 
new  circulatory  dem-inds. 

The  principal  biomechanical  events  no- 
ticed by  the  pilot  are,  of  course,  the  in- 
crease In  direct  pressure  under  all  supported 


49 


parts  ot  his  body,  especially  l!u*  buttocks 
and  back  in  a seat,  and  a tendency  for  all 
unsupported  parts  to  be  driven  "down,**  re- 
quiring a tatiguin>;  increase  in  steady  state 
muscle  lone  just  to  nvaintain  posture.  In  par- 
ticular, Ibe  uirstipport  ed  liead  tends  to  be 
rocked  back  sli^^lulv  lor  the  typical  pilot 
seat  position  witli  the  back  rest  tilted  back 
avav  from  tb<*  v'c-c  t or , Tlie  arms,  bin^'«’d  at 
the  shoulder  and  «'lbow,  are  driven  down  to- 
ward the  leel,  unless  tliey  are  supported  by 
1 !Tn  rests  and  use  ot  a type  ol  side  arm  con- 
troller, in  which  case  there  is  a pressure 
t*oi  Idup  under  each  limb  se^nwnt , Kotli  total 
torce  on  body  s«*^'ments  and  tlie  spatial  dis- 
tribution 4’t  such  torces  are  important  acc<*l- 
eration  cues.  As  the  subject  is  driven  down 
into  his  support  and  the  1 leshy  tisstie  is 
compressed,  diM«‘rent  tactile  sense  enditigs 
come  into  play.  Additionally,  changes  in  the 
tield  ot  view  are  noted  as  the  pilot's  eye 
position  is  depressed  in  the  cockpit.  The 
direct  biomechanical  I'ttect  of  positive- 
forces  on  the  respiratory  system  is  in  the 
production  ot  torces  on  tlie  rib  cage  which 
interfe-re*  with  inhalation  and  m.»ke  breathing 
shallow  and  labored. 

Although  a number  ot  other  physiological 
re-'ponses  to  positive  acceleration  have  b«*en 
ide-nlltied,  the  ones  referred  to  above  appear 
to  be  the  most  significant  from  the  point  of 
view  of  simulation  for  tactical  aircraft 
t ra i ni ng . 

MOT. nr;  and  forck  siMiiixrioN  dkvklopmknt 

A fundamental  control  process  in  which 
all  humans  engage  is  the  control  of  the  static 
and  d^maraic  state  vector  of  their  bodies, 
f *'om  seemingly  rudimentary  skills,  such  as 
learning'  to  crawl,  to  complex  tasks  such  as 
controlling  the  activity  of  powerful  and/or 
high-s^9eed  transport  machines  In  which  he 
rides,  man  employs  a remarkably  clever  set  of 
physiological  sensors  to  mountain  his  safety 
and  sense  ol  well-b<fing  while  accomplishing 
the  state  vector  change  he  desires.  Man 
learns  to  discriminate  among  the  physiological 
stimuli  presented  him  in  order  to  define  and 
refine  his  perception  of  bodily  motion,  and 
then  uses  this  assessment  to  modulate  his 
contr.il  action.  Me  not  only  continually  med- 
iates the  stlrni. U normally  available  to  him 
for  bodily  motion  perception,  but  also  likely 
develops  magnitude  associations  based  on  var- 
iations in  the  composition  of  stimuli  per- 
ceived. 

Platform  Motion  System 

The  perception  of  bodily  motion  Is  con- 


sidered important  in  learning  to  pilot  an  air- 
craft. Mence,  in  aircraft  simulation,  the  art 
of  providing  this  perception,  motion  cuing,  is 
a sinnilati{>n  dlsripline  in  Itself.  The  major- 
ity ot  this  dtsc*ipline  has  cent«‘r<d  iround 
attempting  to  subject  the  pilot  trainee,  plus 
total  simulated  cockpit,  to  a redtn  ed-scale 
semhlanci*  of  llie  accelerations  .issoc'i  at  ed  with 
the  at  tual  aircraft  and  task.  Kor<  e-p roduc i ng 
devices  (nioti»)n  systems)  similar  or  identic  il 
to  the  device  pit  lured  in  Figure  1 ire  em- 
ployed to  present  these  ac ce 1 e r 1 1 i ons  as  well 
as  provide  cues  concerning  static  body  spitial 
orientation.  The  present  it  i i)n  occurs  in  all 
six  degrees  ot  frceitom  and  tias  met  with  some 
acceptaine,  particularly  In  ttw  simulation  ot 
transport  alrcrait,  wlu-re  t raris  1 i r i ona  1 and 
rotitii)nal  acce  lerat  1 ons  ire  normtilly  low  and 
aircratt  attitudinal  changes  ire  nor^illy  con- 
fined to  extreme's  which  do  not  exceed  the* 
motion  attitudinal  cap  ibl 1 i t i«s  by  more  than 
I tactt)r  of  twii  or  ibre.  • j.  The  Air  Force 
is  currently  not  irulud  tig  platform  ouWion 
systems  tor  tbe*  \-10  and  -!*•  simulator  pro- 
g r am.s . 

The'  sing.le'  sLronge*st  isse-t  ot  a motit>n 
systi-m  is  tbit  once  in  tin-  simulated  lockpit, 
tbe*  pilot  is  prese-nted  with  i tone  and 
sp.tliai  ittitudi'  generation  system  wtiicb,  in 
terms  ot  visual  appearince,  usually  is  entire- 
ly taithtul  to  that  existing  in  the*  ntual 
task.  Simulation  engini?ers  working  closely 
with  pilots  note  that  such  visu.il  envi  ronnent - 
al  fidelity  se-em.s  important  towird  en.ibling 
tfie  pilot  to  "slip"  into  believing  be-  is  In 
the  actual  task  so  tliat  he  will  react  in  the 
same-  truanner  as  in  the  ictual  task.  Visual 
environmental  fidelity  is  afforded  by  the  mo- 
tion system  because  the  total  cockpit  and 
pilot  are  moved,  and  thus  vestibular  response 
is  excited  through  tbe  satae  mechanism  as  in 
the  actual  task,  pi  lot /coc kpl t Inertial 
coupling  exists,  aiid  associated  sonvific  sensa- 
tion occurs  naturally  without  artificial  de- 
vices. Mnfortunately,  motion  systems  ire 
constrained  by  the  necessary  physical  limit i- 
tions  placed  on  their  size  ib).  As  the  dy- 
namic range  of  ttie  desired  force  sensation 
increases  and\>r  the  duration  of  di  sired  force 
application  Increases,  these  limi  v i.' ions  be- 
come more  apparent  in  the  sitnulai  ion.  For 
medl  um-per fomtince  tactical  ai  rcraf  t simula- 
tion, the  motion  system  sianilation  engineer 
must  make  increasing  use  of  onset  cuing  plus 
subsequent  washout,  wherein  only  the  leading 
edge  of  the  simulated  aircraft  acceleration 
is  presented  to  the  pilot  trainee,  followed 
by  a low-level  period  wherein  velocity  and 
excursion  capability  expended  during  the  onset 
is  recaptured  In  preparation  for  the  next  cue. 
The  crux  of  the  simulation  engineer's  dllemaa 
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Ill  that  as  he  tries  to  Increase  the  duration 
of  force  application,  the  permitted  cuing  dy- 
namic range  decreases,  and  vice-versa. 

The  dl lenmn  arises  because  in  moving  from 
transport  to  tactical  aircraft  simulation, 
both  desired  force  duration  and  dynamic  range 
increase.  I'nder  these  conditions  it  is  rea- 
sonable that  stronger,  more  pronounced  physio- 
logical perceptions  should  be  available  to  the 
pilot  from  the  somatic  sensory  system  owing 
to  stronger  body/cockplt  inertial  coupling. 
•Should  both  acceleration  duration  and  magni- 
tude become  even  larger,  as  in  the  newest 
tactical  aircraft,  the  frequency  of  occurrence 
of  physiological  effects  associated  with  high- 
G conditions  is  likely  to  be  more  prevalent, 
and  it  is  not  unreasonable  to  extrapolate  that 
these  perceived  effects  will  find  their  way 
into  the  control  patterns  employed  by  the 
pilot.  It  is  apparent,  then,  that  the  physio- 
logical conditions  desired  within  the  simu- 
lation begin  to  outdistance  the  capability 
for  cue  production  through  utilization  of  the 
motion  system  alone.  However,  the  motion 
system  appears  to  have  a useful  range  for 
physiological  stimuli  production  beyond  which 
additional  devices  must  be  brought  to  bear. 

C-Scat 

The  Air  Force  Human  Resources  laboratory 
recognized  this  fact  in  the  late  I960's  during 
the  study  phase  preceding  the  Advanced  Sim- 
ulation in  Undergraduate  Pilot  Training 
(ASUPT)  contract.  A commonly  accepted  con- 
clusion at  that  time  was  that  in  pursuing  the 
development  of  force  stimuli  simulation  de- 
vices ancillary  to  the  motion  system,  first 
importance  must  be  given  to  the  accurate  re- 
production of  somatic  stimuli  associated  with 
the  effects  of  acceleration  in  the  1 to  3 G- 
range;  simulation  of  induced  visceral  effects 
attendant  with  higher  acceleration  regions 
would  follow  at  a later  point  in  time.  The 
logical  candidates  for  somatic  stimulation 
were  those  physiological  systems  which  could 
be  addressed  througli  pilot  seat  alteration, 
since  there  was  a reasonable  chance  to  main- 
tain good  cockpit  visual  environmental  fidel- 
ity it  the  simulation  was  confined  to  the 
seat  itself.  Further,  it  is  quite  apparent 
that  a large  part  of  the  somatic  sensation  in 
the  actual  aircraft  occurs  in  the  buttock/ 
back  region  as  a result  of  pilot/seat  inertial 
coupling  effects. 

Link  tfivlslon  of  the  Singer  Company  de- 
veloped the  C-seat  (7)  pictured  in  Figure  2 
under  the  ASUPT  contract  lor  the  express 
purpose  of  determining  the  adequacy  of  simu- 
lating tactile,  pressure,  and  skeletal  stature 


Btlmull  associated  witli  f 1 1 gh t -Induced  body  G 
loading.  Tlie  approacii  selected  Involved  con- 
struction of  seat  cushions  composed  of  mosaics 
of  elements  in  which  the  elevation  of  each  is 
individually  controlled  by  the  drive  philo- 
sophy programmed  into  the  simulator's  compu- 
tational system.  It  is  therefore  possible  to 
change  cushion  attitude,  elevation,  and  shape 
with  the  s.ame  mechanical  system.  The  C-seat 
employs  a variable-tension  lap  belt  to  apply 
pressure  stimuli  in  the  ventral  area  of  the 
pilot  during  negative  G and/or  braking  con- 
ditions, the  C-seat  drive  philosophy  developed 
by  Link  primarily  addresses  the  skeletal  at- 
titude shifts  and  their  Impact  on  eyepolnt 
perspective,  head/neck  bobbing,  and  flesh 
scrubbing  as  well  as  localized  flesh  pressure 
changes  and  tactile  perceived  area-of-f lesh/ 
seat  contact  changes  associated  with  sustained 
C conditions.  Fxperimentation  with  this  seat 
indicated  that  not  only  were  the  sustained  G 
stimuli  presented  by  tfie  seat  employed  posi- 
tively by  pilots  in  the  control  of  the  simu- 
lated aircraft,  but  in  moving  from  one  ac- 
celeration magnitude  to  another,  a form  of 
acceleration  onset  information  was  provided  to 
the  pilot.  Tlu?  two  A.SITT  C-seats  were  the 
first  of  ten  similar  "First  Generation"  C- 
seats  built  or  currently  under  construction 
for  use  hy  thi'  Air  Force  and  Navv.  During 
this  period,  the  value  of  the  G-suIt  as  a G- 
culng  device  has  hecorae  more  hroadlv  appre- 
ciated. 

('.-.Suit 

The  C-sult  cue  represents  an  excellent 
example  of  apparent  pilot  G-level  .issessment 
hy  wav  of  association.  C-suIts  are  employed 
in  tactical  aircraft  to  counter  blood  pooling 
in  the  lower  extremities  during  hlgh-C  condi- 
tions. Providing  external  pressure  to  tfie 
lower  ext  r«*ml  t les  , the  suit  restricts  the 
blood  from  settling  under  Inertial  forces  and 
thereby  m.ilntalns  more  normal  blood  pressure 
conditions  at  the  heart  level  and,  more  im- 
portantly, retards  blood  starvation  .it  the 
elevation  of  the  brain,  thereby  extending 
eltlier  C-level  range  or  exposure  time  prior  to 
loss  of  vision  .and  subsequent  uncc'nsclousness . 
A p ri’dom I n.in t early  perception  experienced  hv 
the  pilot,  well  before  anv  visceral  effects 
materialize  in  vision,  is  a tactile  perception 
.issocl.ited  wltli  the  pressure  Induced  by  the 
G-sult.  Ihe  pilot  appears  to  assoclati'  this 
percept  l('n  with  Increased  ('•  loading.  Provid- 
ing a similar  experience  within  the  simulation 
bv  Inflating  operationally  Issued  C-sults  ac- 
cording to  the  simulated  flight  C loading 
produces  .a  very  strong  (I  lo.idlng  rue  fc'r  pilot 
utilization.  hquallv  Important  is  the  fact 
tfiat  tills  cue  is  m.ade  available  hv  a device 
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Figure  2.  First  Generation  G-Seat  (Backrest  Bellows  Kxposed) 
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which  Is  present  in  the  .irtii.il  task,  and, 
therefiire,  vlsti.il  env  1 renmen  t a 1 f 1 tie  1 1 1 v is 
maint. lined  witliin  the  s imul  a 1 1 an  . 

SisiJ  Sh.ik  e r 

I'elncldent  with  (.-seat  and  (l-siilt  utili- 
zation, seat  It. mi  shaker  systems  have  been 
tieveloped  to  provltle  vibratory  cues  in  the 
treqni'nry  r.inge  beyond  that  readily  obtainable 
with  lorkplt  motion  svstems.  Vibratory  cues 
are  .i  p.irt  of  the  torce  I'nvironment  somat- 
ically monltoreii  bv  the  pilot  and  used  witliin 
his  control  p.itterns.  Much  as  any  larKe 
machine,  .in  aircraft  "talks"  to  its  pilot 
through  vibratory  means,  providing  information 
concerning  its  operation  and  its  status  within 
the  realiz.ihle  flight  envelope.  In  terms  of 
<;-culng  svstems,  if  the  motion  system  is 
labeled  the  low-range  device,  the  (l-seat, 
suit,  .ind  shaker  systems  would  be  considered 
mid-range  (1- cuing  systems. 

l.iml  tat  Ions  and  Ranges  of  G-Cu ing  Devices 

Tile  successful  introduction  of  the  (1- 
seat  within  the  t.ictic.il  aircraft  simulation 
environment  has  been  an  extremely  significant 
milestone  in  terms  of  mid-range  (i-culng.  How- 
ever, Just  as  the  motion  system  has  its  llmi~ 
rations,  so  does  thi-  (1-seat,  As  previously 
nHntioned,  the  (1-seat  confines  its  physiolog- 
ical Htlnull  production  to  the  pilot/seat 
Inertial  coupling  area.  It  makes 
no  demands  upon  the  pilot  other  than  to 
sit  In  the  seat  and  buckle  the  strapping 
used  In  the  seat  and  in  the  actual  aircraft, 
thereby  maintaining  visual  environmental 
fidelity.  As  a consequence  of  this 
approach,  pressure  buildup  In  the  back/ 
buttocks  area  Is  limited  to  that  available 
from  the  1-G  weight  of  the  subject  himself  as 
modulated  by  variation  In  the  shape  of  the 
flesh-supporting  surface.  Neck  muscular  stim- 
uli associated  with  G loading  of  the  helmet 
and  head  are  limited  to  those  available  by 
changing  the  attitude  of  the  torso  so  that  the 
1-G  gravitational  weight  of  the  helmet/head 
loading  varies  neck  load.  Head  bobbing 
through  Interplay  of  skeletal  structure  and 
cushion  surface  attitude  is  limited  to  that 
range  of  attltudlnal  change  permitted  as 
complementary  by  the  somatic  senses  of  the 
back/buttocks  area.  Inertial  load  buildup  In 
the  arms  Is  nut  directly  addressed.  Visceral 
effects  and  their  perceivable  by-products  are 
Ignored  altogether.  Yet  as  the  dynamic  range 
of  aircraft  acceleration  increases,  as  1 t has 
with  the  introduction  of  advanced  fighter 
aircraft.  It  Is  not  unreasonable  to  hypothe- 
size that  future  force  simulation  systems 


must  include  some  of  these  hIgh-C  effects. 

Tile  development  of  kinesthetic  cuing 
devices  can  be  likeni'd  to  the  development  of  a 
speaker  system.  As  the  range  of  iniormation 
to  he  t ransml  t tiMl  Increast's  or  its  composition 
changes  to  Incluile  new  pieces  of  inform.ation 
important  to  he  he.ird,  the  transmission  di-vice 
must  be  altered.  In  some  cases  the  device  is 
designed  to  address  specific  characteristics 
and  cannot  adequately  cover  the  complete 
spectrum  of  information  to  he  trinsmitted.  In 
speaker  technology  the  answer  has  been  to  em- 
ploy ilifferent  speaker  designs  in  the  area  of 
their  respective  merit  hut  collectively  as  one 
integrated  system:  low-range  woofers,  mid- 
r.inge  speakers,  anil  high-range  tweeters.  A 
corollary  may  exist  In  kinesthetic  cuing  de- 
vices when  examining  the  merits  and  limitations 
of  motion  systems  and  G-seat  systems.  Advanced 
fighter  aircraft  extend  and  change  the  composi- 
tion of  kinesthetic  cues  to  be  delivered.  The 
high-G  augmentation  devices  discussed  herein 
may  be  considered  as  independent  operators  and 
would  be  designed  to  provide  specific  sensa- 
tions. Tlielr  true  merit,  however,  lies  In 
extending  the  spectrum  of  Information  trans- 
mission when  used  in  tonjuctlon  wltli  (.-seats 
and  motion  systems. 

ADVANCKI)  G-Ci’ING  .SYSTKM  DKVTI.OPMMNTS 
Advanced  l.ow  Cost  G-Gulng  System 

Tlie  Introduction  of  the  first  generation 
G-seat  to  the  tactical  aircraft  simulation 
environment  demonstrated  the  .ipparent  poten- 
tial for  inducing  valuable  kinesthetic  stimuli 
via  a direct  approach  to  the  somatic  sensorv 
system.  However,  questions  arise  as  to 
whether  the  mechanical  capabilities  of  the 
first  generation  G-seat  optimally  exercise 
this  potential  and  extract  a maximum  benefit 
frexn  this  cuing  source.  Can  Improvements  In 
selected  areas  Increase  the  cuing  yield  and  If 
so,  what  areas  and  what  type  of  Improveuu  pts 
should  be  considered?  In  1975,  the  Air  Force 
released  a specification  defining  G-seat 
requirements  for  future  G-seat  procurement. 
Additional  G-seat  research  is  required  to 
establish  a baseline  system  reflecting  optimum 
performance  capabilities.  These  capabilities 
would  then  be  included  within  and  modify  the 
specification  controlling  G-seat  procurement. 

One  point  of  particular  concern  in  any 
cuing  system  has  been  system  response  (8). 

The  first  generation  C-seat  employs  a servo 
system  of  approximately  1 Hz  bandpass. 
Initially,  a fairly  low  software  Iteration 
rate  In  the  7 1/2  - 10  Iterations/second 
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r.inK»‘  wi  r«*  to  ilrivo  tho  (J-so.U  . Al- 

ihoii^ih  undrr  loit.iin  sharp  matUMivo r i ri>n- 
liitii’iis  ttuTr  is  lU’casional  pilot  conuiK-nt 
nofin>;  apparont  tinu-  dol.jvs  in  tho  stat 
sv'.tom,  it  is  inM  km>wtt  vhotiuT  this  Is 
puiolv  a ronso(}tn-nct‘  of  iho  iteration  rate  or 
wIu'IIh'I  impri’Veii  h.iriiw.ire  response  would  be 
ot  m.tterial  beinfit.  Iteration  rate  altera- 
tion rt*seareh  at  the  i n?;  ta  I lat  ions  currently 
♦•mplovln>:  (i-seats  is  n<’t  easily  accomplished. 
Kaeilitv  computational  capability  constraints 
are  tuu’ountered  becausr  the  iteration  rate  to 
be  allereti  is  nt't  i>nly  the  (l-seat  software 
but  usually  the  complete  flight  dynamics 
p.ickage  as  well.  To  establlsli  the  most 
beneficial  response  requirements,  it  Is  ad- 
visable to  employ  a computat  l('nal  facility 
within  which  flight  dynamics  and  (I-seat  soft- 
ware can  be  cvcled  at  rates  in  excess  of  that 
tlnaight  to  In*  the  maximum  required  and  employ 
se.U  har<!w.ire  possessing  high  response  char- 
.icterisi  ics . In  this  manner,  full  system 
capability  can  be  degraded  to  determine  that 
point  .it  which  further  degrad.atxon  produces 
adverse  .ind  noticeable  system  delays. 

Tlie  first  generation  Oseat  was  designed 
to  provide  a sensation  of  sustained  accelera- 
tion and  employs  a cuing  philosophy  wliich 
does  luU  imike  use  of  transient  onset  cuing 
(7).  This  approach  iias  been  well  received  as 
a sustained  cuing  device  and,  somewhat  unex- 
pectedly, it  was  found  that  a measure  of 
onst't  cuing  is  overtly  experienced  as  a by- 
product of  the  sustained  cuing  philosophy. 
Nevertheless,  ongoing  work  in  sensory  systems 
modeling  Indicates  that  improved  kinesthetic 
cuing  should  be  attainable  through  more 
sophisticated  transient  cuing  drive  schemes. 
Again,  it  is  desirable,  when  considering 
transient  motion,  to  employ  Mgfily  responsive 
hardware  as  tfie  initial  starting  point  and 
experimentally  degrade  the  response  to  that 
level  wtiereln  transient  cuing  concepts  are 
noticeably  and  adversely  affected. 

With  the  foregoing  In  mind,  the  Air  Force 
Human  Kesources  I.aboratorv  concluded  a C,- 
Culng  System  research  test  bed  was  required 
and  In  raid-1976  awarded  Link  a contract  tor 
the  development  of  an  Advanced  Low  Cost  G- 
Cuing  System  (AlXOdS)  embodying  certain 
specific  objectives: 

1)  Bring  seat,  suit,  and  shaker  to- 
gether as  one  integrated  system  with  common 
cont  rol . 

2)  Improve  the  response  characteristics 
of  primarily  the  G-seat,  and  secondarily  the 
G-sult,  over  those  existing  in  today's  oper- 


.itlon.'il  seat/suit  systems. 

^)  I’rnvide  closed-loop  servo  operation 
so  tli.it  accurate  means  to  m«*asure  system 
capability  expenrled  to  produce  a given  cue  can 
he  mon i tored . 

4)  Investigate,  develop,  and  embody 
within  the  final  system  mechanical  concepts 
which  improve  the  somatic  cuing  quality  of  tiie 
(i-seat  over  that  avall.ihle  in  the  first  gener- 
ation of  (i-seat  approach. 

5)  Broaden  the  resultant  h.irdware  and 
software  design  to  accommodate  K-16-tvpe  tilt- 
back  seat  configurations  as  well  as  the  more 
convent lonal  upright  seat  ronf igurat Ions 
associated  wltli  the  K- 1 5 and  other  aircraft. 

6)  Attempt  to  design  this  system  so  as 
to  lower  the  aggregate  cost  of  a si‘at/suit/ 
shaker  system. 

7)  Build  and  deliver  a system  with  the 
above  characteristics  as  well  as  a software 
drive  module  for  Air  Force  research. 

Tlie  ALCOGS  system  has  been  designed  and 
Is  currently  under  construction.  /\n  artist's 
rendition  of  Its  seat  configuration  is  pro- 
vided in  Figure  1.  nie  most  noticeable 
changes  from  the  first  generation  G-seat  are: 

1)  'Hie  departure  from  a mosaic  element 
cushion  approach,  but  the  retention  of  cushion 
altitudinal  and  elevation  change  capability. 

2)  nu*  implementation  of  thin  cushion 
surface  bladders  for  localized  pressure  and 
tactile  area-of-contact  stimuli  generation. 

3)  Hydraulic  actuator  servo  systems  to 
provide  the  desired  response  characteristics. 

4)  Adoption  of  passive  rather  than 
active  seat  pan  thigh  panels. 

5)  Hie  implementation  of  lower  backrest 
radial  elements  to  provide  strong  area-of- 
contact  cues  for  vertical  and  longitudinal 
acre le rat  ion . 

6)  Differential  lap  belt  drive  for 
Inclusion  of  lateral  as  well  as  longitudinal 
and  vertical  belt  cuing. 

7)  The  addition  of  a seat  pan  longitudi- 
nal degree  of  freedom  cascaded  on  seat  pan 
ciiBhlon  pitch  roll  and  heave. 

The  ALCOGS  G-seat  cushion  assemblies  are 
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mounted  In  a rrplica  of  the  F-15  seat  frame 
wtifcfi  In  turn  Is  mounted  on  a test  htuf  frarn*- 
wfilih  I an  eltfu'r  he  inserted  in  a T-18  cockpit 
or  left  free  standing  ext**rnal  to  the  cockpit, 
nu*  seat  fram«-  is  supported  on  tfu*  test  bed 
t r.ime  by  link.i^es  which  permit  tije  seat  t('  be 
orientc'xi  at  any  an>;le  of  inclination  betwe»*n 
th.it  i'm])lo\a*d  bv  t!u*  F- 1 S and  F-lb  seats. 

The  seat  frame  is  pinneil  ti’  ifu*  t«'St  bed  so  as 
to  permit  tile  frame  to  be  vibrated  bv  a seat 
sh.ikt-r  actuator  at  + \/2  U in  tiu‘  - AO  Hz 

ran^;e.  Buffet  .ind  (>ther  vil'ratory  effects  may 
be  displayed  bv  tin-  st'.it  f r.ime  siiaker  or, 

.il  t»‘rnate  I V , th«'  se.it  pan  rusiiii'n  Itself.  'Hie 
suit.ibllitv  of  tile  latter  will  (ietermlne  if 
I lie  role  of  tile  s«‘.it  f r.ime  sfiaker  may  iw  ab- 
sorbed bv  the  (i-se.it  .ind  the  seat  frame  sfiaker 
sv>tem  elimlnat»'d  from  future  G-Cuinx”.  Systems. 

nie  G-suit  features  a press-to-test  and 
pri*Hsure/G  instructor  injiut  wfiicli  are  iiandled 
al  1-elect  ronlral  Iv  rather  tiian  by  meciianlcal 
and  software  means,  respectively.  A iii^ii 
volume  pneumatic  servo  valve  design  serviced 
bv  cc’rapressed  .ilr  atul  vacuum  provide  more 
rapiii  suit  pn'ssur  i za  t Ion  and  ex.aust  tiian 
tii.it  .iv.iilable,  for  example.  In  the  Simulator 
for  Alr-to-Air  Comb. it  (SAAC)  and  KAK18  (l-sult 
i ns  t .1 1 1 a t i ons  . 

Similar  t('  manv  motion  system  instal- 
lations, the  C.-(uin^  System  Is  supported  bv  an 
electronics  cfuitrol  cabinet  which  houses  the 
e lei- t ron  i < .s  .issoc  i .ite<i  with  system  control 
logic  and  tiie  sixteen  servo  loops.  ’Hie  Elec- 
tronics Cofitrol  (.ihinet  permits  system  opera- 
tion in  .1  "nvi Intenance " mode  wiierein  tiie  (>- 
(ulng  System  servos  may  he  driven  manually,  or 
by  two  software  drive  modes:  one  wherein  sys- 
tem control  is  maintained  at  the  location  of 
Che  electronics  cabinet  and  a second  wherein 
system  control  is  transferred  to  a remote 
location  such  as  a simulator  Instructor/opera- 
tor station.  Tile  electronics  cabinet  employs 
two  varl.ible  frequency  oscillators  to  permit 
the  generation  of  superimposed  vibratory  ef- 
f»*cts  at  any  frequency  In  the  A.  5 to  AO  Hz 
region.  A discrete  ’’hump"  channel  Is  further 
superimposed  upon  the  vibratory  output.  llu* 
electronics  rablnet  also  controls  tiie  activity 
of  tiie  G-('ulng  System  pumping  station  wiierein 
hyiiraullc,  pneumatic  compressor,  vacuum  pumps, 
and  associated  reservoirs  are  located. 

I’rlmary  design  problems  centered  in  the 
G-seat  system  and  In  two  areas:  system  re- 
sponse and  packaging.  Two  G-seat  design  ob- 
jectives called  for  seat  pan  and  backrest 
cushion  excursion  of  2-1/2  Indies  and  a rise 
time  of  all  servo  actuators  of  10  ms  or  less. 
The  latter  implies  a system  bandpass  of  10  Hz 


or  an  ordt*r  of  magnitude  larger  than  that 
available  in  the  first  generation  G-seat. 

Tlie  ii.incipass  objective  advocates  tiie  utlll- 
zaf  ion  of  ijydr.iullc  actuators  and,  to  ensure 
tliat  iivdraullc  rescmant  frequencies  are 
maint.ilneti  well  above  tiie  bandpass  frequency, 
servo  valve  mounting  In  close  proximity  to 
tiie  actuator.  'Fiie  servo  valve/actuator 
selecte<l  m€‘(*ts  the  10  Hz  bandpass  objective. 

Fven  more  challenging,  tiie  same  30  milli- 
second rise  time  objective  was  sougiit  In  the 
cusiilon  pneumatic  surface  bladders  (firmness 
bladders)  overlaying  both  seat  pan  and  back- 
rest cusiilons.  A dual  compartment  (right  and 
left)  bladder  is  employed  on  tiie  seat  p.m  and 
.1  single  compartment  bladder  employed  on  the 
iiackrest.  Altiiougii  only  approximately  one 
inch  tiiick  when  Inflatetl,  tiiese  bladders 
represent  significant  volumes.  Basi*d  on  the 
function  of  the  bladders,  pressure  and  tac- 
tile area  of  contact  stimuli  generation  in- 
duced bv  depressurization  and  resultant  flesii 
cont.ict  witfi  the  undersurface  supporting  the 
bladders,  it  was  felt  the  driving  medium  must 
he  air.  After  considerable  searciiing  and 
testing,  a two  stage  pneumatic  servo  valve 
assembly  was  developed  whicli  can  liandle  the 
largt*  air  volume  at  tiie  desired  10  ms  rise 
t ime  object i ve. 

It  is  apparent  that  tiu*  response  design 
objective  r(*qui  red  the  utilization  of  servo 
actuators  considerably  more  median  1 cal ly 
sopii  Is  1 1 cated  than  that  employed  in  the  first 
generation  G-seat.  System  cost  reduction 
could  be  realized,  tlierefore,  only  If  the 
cusiilon  assemblies  could  be  packaged  in  sucii 
;i  manner  as  to  permit  .i  broad  application  to 
manv  different  seat  styles  witii  minimum  re- 
design. A design  objective  tiien  was  to  pack- 
age tiie  cushion  assemblies  within  volumes 
commensurate  wltii  that  extant  In  standard  sur- 
vival kits  and  paraciiute  packs.  Iliis  task  was 
made  difficult  by  the  number  of  actuators 
employed,  the  fact  that  these  actuators  are 
iivdraullc,  tiie  desire  to  keep  actuator  and 
servo  valve  in  close  proximity  to  one  another, 
and  the  2 1/2-incii  cushion  stroke  requirement 
coupled  wltii  ram  end  cushion  capability.  Tiie 
resultant  design  packages  five  servo  systems 
in  a backrest  assembly  whlcii  is  approximately 
15  X 21  X '1-3/A  indies  In  dimension.  Tiie  seat 
pan  assembly  packages  six  servo  systems  in  a 
volume  approximately  15  x 15  x b Inches  in 
dlnM*nslon.  A modular  design  approach  iias  been 
employed  In  tiie  actuator  assemblies  tiiemselves 
in  order  to  permit  actuator  set  up  and  service. 

'Hie  Al.i  OGS  system  will  be  Integrated  with 
tiie  WrI  giit-Fatterson  AFB  Human  Resources 


57 


fon  c<>nt  nW 


1 alu-i  atorv  Simiil.iiion  -iiul  IraiiUMy’.  A<lv.inc<><l 
Kt-starch  Svstt’m  (S'lAKS)  anu  it  is  t'X- 

th.Jt  r«*si*.ir(!i  will  cDnimorn  e 

tit  i lining  this  svstrm  prior  iti  tlu*  ond  of  M177. 

Atigmt»utat  ion  Doviro  Stiidv 

As  montiotu'd  o.irlior,  tho  <i-soat  may  bo 
ct'ns  i do  ro<i  .1  mid-ran^o  (•-^tiin^  tU’vlct?.  Nowlv 
tlfVflopod  tactical  aircraft  oxorciso  a flight 
ri'xim*'  wlioroiii  hi^h-(-  loading  is  moro  I'fton 
oxporiontod  and  the  phvs i o log  1 ca 1 stimuli  as- 
s(>ciarovl  with  this  condition  mav  gain  Inipor- 
t.invo  in  aircraft  maneuvering  control  patterns, 
based  (’n  tills,  it  is  appropriate  to  commtuice 
consivler.it  ion  of  the  tvpes  of  simulator 
systems  whicfi  might  provide  high^d  effect  stim- 
uli. 

A combined  Human  Resources  Laboratory/ 
-Vas.sachuse  t ts  Jn.stitt]t€*  of  TechnoJ  ogv/I.  j nk 
effort  is  currently  studying  potential  force 
*'imulation  systems  in  an  attempt  to  idc'ntifv 
those  systems  which: 

a.  are  llkelv  to  produce  a stimuli  im-- 
portant  to  high-G  maneuvering  control  and, 

h.  appear  to  he  able  to  generate  stimuli 
.irt  i f i(  l.il  ly  in  a U.  environment  by  means  ac- 
ceptable ti’  operational  pilots. 

Tile  current  effort  is  strictly  a studv 
leading  to  characterization  of  the  type  of 
hardware/software  systems  required  to  produce 
tlu'  desired  end  effect.  Tlie  system  character- 
ization is  to  form  the  foundation  for  eventual 
ct>nst  ruct  ion  of  experimental  systems  to  deter- 
mine the  adequacy  and  usefulness  of  the  simu- 
lation stimuli  source. 

7?ie  studv  wili  attempt  to  set  forth  the 
most  reasonable  methods  of  gener.jtlng  G load-  • 
Ing  stimuli  in  the  following  areas: 

a.  Sfjoulder  harness 

h.  Head/helmet  coupling 

c.  Limb  loading 

d.  Aural  effects 

e.  Visual  effects 

Tfie  effort  In  addition  to  addressing  the 
above  specific  areas  will  investigate  the  po- 
tential of  stimuli  production  via  some  of  the 
following  methods: 

a.  Body  negative  pressure 

h.  Respiratory  coatrol 


d.  Flesfi  prossure/temperature  inferrela- 
t ionsh i ps 

B um  ■ c Con trol  of  Simulator  Vi  sual  Displays 

H i o- feedback  techniques  are  also  being 
cf*nsidered  for  the  tactical  aircraft  simulator 
pilot.  Tile  I’niversitv  of  Davton  is  currently 
developing  for  the  Air  orce  a method  for  bi- 
onic control  of  the  simulator  cockpit  visual 
envi ronment . 

Tlie  objective  of  this  eff<'rt  is  to  Im- 
prove a teciino log i ca  1 deficiency  which  current 
Iv  exists  in  training  simulation.  Gravity 
eifects  are  simulated  in  ground-b.ised  trainers 
via  motion  systems,  (J-seats,  G-suits,  seat 
siiaker  systems,  and  visual  cues.  All  of  these 
(J-cue  effect  devices  iiave  tiieir  strengths  and 
we.iknesses . 'Iliis  effort  will  address  the 
gravity  effect  produced  by  current  visual 
simulation  systems.  State-of-the-art  training 
devices  have  the  c.ipability  for  dimming  tlie 
visual  display  of  the  simulator  as  a function 
of  positive  (» . 'Hiis  effect  simulates  the  loss 
of  vision  pilots  sometimes  suffer  under  high, 
positive  acceleration.  The  Simulator  for  Air- 
to-Ai  r Combat  (S/\A(!)  is  a gooil  example  of  this 
technology.  The  problem  with  tliis  simulation 
is  tfiat  the  pilot  ?ias  no  phys  iolog ic.jl  control 
over  the  (1)  inter  >ity  and  (2)  onset  of  this 
dimming  in  the  SAAC.  He  cannot  ^ .for  e:<ample, 
perform  the  M-1  maneuver  and  elin?*inate  the 
dimmed  display;  he  has  no  direct  means  of  af- 
.f>’crfing  .fbe  display  in  the  simulator  otiier 
ttlAn  changing  angle  of  attack,  etc.  In  the 
actual  aircraft,  however,  tlie  pilot  can  con- 
trol the  loss  of  vision  tlirough  the  M-1 
maneuver.  The  purpose  of  this  effort  Is  to 
develop  a means  by  which  pilot  straining,  via 
the  M-1  maneuver,  can  be  sensed  and  used  in 
the  total  simulation  control  loop  to  drive  the 
dimming  level  of  the  visual  display  as  a 
function  of  G.  Such  a development  should  en- 
hance the  tactical  air  combat  simulation  and 
provide  valuable  training  In  pilot  energy 
managemtmt . 

This  effort  encompasses  the  de*;lgn  and 
development  of  a software  progr^ini  and  associ- 
ated hardware  for  the  bionic  control  of  ac- 
celeration induced  dimming  of  the  simulator 
pilot's  visual  display.  To  acct^mplish  this, 
two  algorithms  will  be  developed.  One  will  be 
a dynamic  algorithm  of  the  human  visual  system 
which  will  be  driven  by  the  pilot's  G-environ- 
ment.  The  other  will  be  an  algorithm  to  pre- 
dict the  effectiveness  of  the  pilot’s  M-1 
maneuver,  which  wHl  be  driven  by  electro- 
myographic potentials  from  selected  muscle 
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groups.  Hu*  outputs  f rt>m  llu'so  two  u lg<'r  i thms 
will  hv  iutogr.itod  to  <lrivo  a brightness  ron- 
trollor  for  the  visual  illsplav.  Tlie  integra- 
ted system  will  he  implemented  at  the  AFHRl 
STARS  t.u  ilitv  on  tlie  T- IH  simulator.  If 
sueeesstul,  the  system  mav  he  Implementc'd  on 
thi‘  SMi  , IT’T-IFS,  and  other  Air  Fi>rce  simu- 
lator programs. 


CONCI.rSION 

nu*  suceessful  introduction  of  tlie  ('•- 
seat  within  the  tactical  aircraft  simulation 
environment  h.is  been  an  extremely  significant 
milesti'ne  in  terms  (’>f  mid-range  (1-cuing.  How- 
ev'er,  ju'^l  .IS  the  motion  svstem  h.as  its  liml- 
t. It  Jons,  so  d<-‘es  the  li-seat.  With  the  possl- 
hllitv  that  the  A-10  and  F-Ih  simulators  wiU 
iMve  no  platform  motion  systems,  the  Air  Force 
Human  Resi>urces  hahoratorv  is  performing  the 
re'^earch  and  deve  1 i>pmt'n t of  other  mi-.ins  of 
full-range  (i-cuing.  High-(i  augmentation  de- 
vit'es  are  being  designed  to  provide  those 
specific  siuisations  characteristic  of  fighter/ 
attack  aircraft.  An  adv.anced  (i-cuing  research 
svstem  has  been  dc*veloped  which  can  address 
tfie  A-IO,  F-15,  and  F-lh  motion  and  force 
simulatlt>n  problems.  However,  the  true  merit 
of  these  and  other  devices  lies  in  their  afjil- 
itv  to  matcfi  tin*  spectrum  of  kinesthetic  cues 
delivereil  in  advanced  tactical  aircraft. 
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ABSTRACT  AND  SURMARY 

A seat  cushion  to  provide  acceleration 
cues  for  aircraft  simulator  pilots  has  been 
built,  performance  tested,  and  evaluated  in 
‘.ASA  Langley's  Differential  Maneuvering 
Simulator.  The  four-cell  seat,  using  a thin 
air  cushion  with  highly  responsive  pressure 
control  , attempts  to  reproduce  the  same 
events  whicn  occur  in  an  aircraft  seat  under 
acceleration  loading.  The  pressure  con- 
troller provides  seat  cushion  responses 
which  are  considered  adeguate  for  current 
nigh-perton;;ance  aircraft  simulations. 

An  experiment  was  designed  to  evaluate 
the  effect  of  the  g-seat  on  pilot/simulator 
perfoneanci.  The  statistical  analysis  of 
data  indicates  that  tne  pilot  gets  informa- 
tion fra.  the  seat  which  allows  more 
precise  control  of  tne  simulated  aircraft. 
Pilot  Subjective  data  support  the  conclu- 
sions of  tne  statistical  analysis. 

I_ntr_oduction 

li^  the  control  of  an  aircraft,  the 
!■  inesthetic  cues  or  "seat-of-the-pants" 
feel  provide  important  iriformation  to  the 
pilot  concerning  the  aircraft's  dynamic 
state.  Pilots  sense  such  kinesthetic  cues 
as  buffet,  control  forces,  and  linear  and 
angular  accelerations.  One  of  the  most 
importat.t  of  tne  acceleration  cues  is  the 
norn'al  acceleration.  Under  positive  nonral 
acceleration,  tne  pilot  is  subjected  to  an 
increase  in  weight  for  each  part  of  the  body. 
Ihis  results  iii  such  things  as  tne  blood 
pooling  in  tne  lower  portions  of  the  body 
and  a reduced  blood  flow  to  the  head  which 
eventually  results  in  tunnel  vision  and 
blackout.  (Reference  2).  The  increased 
body  weight  also  causes  increased  pressure 
on  the  "seat-of-the-pants“  as  the  seat 
cushion  padding  becanes  fully  compressed 
and  no  longer  confonrs  to  the  pilot's 
buttocks.  This  causes  a greater  portion  of 
ttie  pilot's  weignt  to  be  borne  by  the  area 
around  tne  tuberosities  (the  two  bones 
which  protrude  furthest  into  the  buttocks) 
arid  thus  a change  in  the  pressure  distribu- 
tion on  the  buttocks. 

Inert-  are  otiier  acceleration  cues  such 
as  heaviiji-ss  in  the  extremities;  however. 

Lire  "seat-of-the-pants"  feel  seems  to  be 
one  of  the  most  noticeable.  In  view  of  this, 
a seat  cushion  was  designed  and  built  to 
reproduce  these  pilot  sensations  in  an 
aircraft  simulator.  This  paper  describes 
tne  ap'proach  to  the  cushion  design,  the  seat 


transfer  functions,  and  the  design  of  an 
experiment  to  discriminate  between  pilot 
performance  with  and  without  the  seat  cues. 
The  statistical  analysis  of  the  data  and 
pilot  opinions  concerning  the  realism  of 
the  seat  and  its  value  as  a perfonnance  aid 
are  presented. 

Seat  Cushion  Design 

The  objective  in  building  the  simulator 
seat  cushion  is  simply  to  reproduce  as 
nearly  as  possible  the  same  events  which 
occur  in  the  aircraft  seat.  In  order  to 
compress  the  seat  padding  as  if  the  pilot 
weighed  more,  air  with  pressure  control  is 
used  as  the  padding  material  with  a non- 
compressible  surface  (wood)  underneath  the 
air  cushion.  The  basic  design  is  shown  in 
F igure  1 . 

The  seat  is  initially  biased  such  that 
the  air  conforms  to  the  pilot  to  support 
most  of  his  weight  as  shown  in  Figure  2. 

The  initial  air  pressure  allows  the  two  main 
support  areas,  the  tuberosities,  to  touch 
the  wood  surface  and  thus  begin  to  compress 
the  flesh  near  these  areas.  Thus,  the  bias 
adjusts  the  "firmness"  of  the  seat.  Then  as 
accelerations  increase  (positive  g)  air  is 
ren:oved  from  the  seat  giving  the  effect  of 
cai;pressing  the  cushion  rcatetial  and  causing 
more  of  the  pilot's  weight  to  be  supported 
by  the  area  around  the  tuberosities. 

However,  some  air  is  left  in  the  seat  to 
prevent  the  false  cue  of  the  seat  falling 
away  from  the  sides  of  the  legs  and  buttocks. 
For  negative  g,  sufficient  air  is  added  to 
seat  to  remove  al 1 contact  with  the  wood 
and  thus  uni fonnly  support  the  body  weight, 
without  becoming  finii  due  to  too  much  air. 

This  manner  of  seat  operation  (i.e. 
reproducing  the  aircraft  seat  actions) 
automatically  reproduces  otiier  related  pilot 
events  as  raising  or  lowering  the  body  which 
results  in  changing  the  eyepoint  and  the 
joint  (hips  and  knees)  angles. 

The  full  seat  design  (Reference  1)  is 
shown  in  Figure  3.  The  air  cushion  is  made 
of  pliable  rubber  and  has  four  air  cells 
per  seat  and  back  cushion  with  individual 
pressure  controllers  for  each  of  the  eight 
cells.  This  allows  differential  control  to 
"tilt"  the  seat  pans  for  various  cues.  The 
air  cushions  are  2.54  cm  (1-inch)  thick  to 
minimize  "following"  as  the  pilot  shifts 
his  weight  and  to  increase  response  time  by 
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lowering  tlie  jir  volune  required.  The 
"fol lowing"  occurs  wnen  the  pilot  moves  in 
Sjcn  a mantlet  to  renove  a part  of  liis 
tuttoci  area  tror  cctifact  with  the  seat. 

Ine  constatit  air  pressure  would  cause  the 
seal  cell  to  "follow"  tne  moving  area  until 
the  seat  reacncs  the  limit  of  its  excursion 
capability.  In  this  case,  the  maximum 
’following"  would  be  2.54  cnt  (I.inch)  or 
less. 

Pressure  Control 

Ine  innerent  design  of  tne  seat  requires 
precise  and  responsive  control  of  the  air 
pressure  in  each  cell.  Therefore,  the  servo 
controller  utilizes  pressure  feedback  as 
shown  in  iiyure  4.  The  design  uses  large 
air  lines  (3/4-inch  ID)  and  locates  the 
pressure  transducer  at  the  air  cell  to  get 
true  seat  cushion  pressures  as  stiown  in 
Figure  5.  The  air  control  valve  used  is  a 
standard  aircraft  anti-g  suit  valve  with 
the  noniial  activating  slug  replaced  by  a 
motor  whicli  provides  the  linear  actuation 
of  tne  valve  as  shown  in  Figure  6.  The 
aircraft  valve  was  chosen  because  it  provides 
adequate  pressurization  time  and,  more 
importantly,  adequate  bleed  time  without 
the  use  of  other  devices  sucii  as  booster 
relays  which  tend  to  degrade  the 
pressurization  tinte.  The  valve  has  a non- 
linear relationship  between  the  input 
displaceirent  and  the  output  pressure, 
however,  the  pressure  feedback  provides 
linear  response. 

Seat  Cushion  Response 

In  the  design  of  the  servo  controller, 
it  was  considered  important  for  the  seat  to 
follow  the  cormand  with  minimum  time  lag  in 
order  to  be  able  to  respond  to  the  aircraft 
dynamics.  It  was  also  desired  to  closely 
match  the  seat  response  with  the  simulator's 
visual  display  response.  The  design  of  the 
seat  requires  a decrease  in  air  pressure 
(and,  consequently,  more  of  the  pilot's 
buttock  area  contacting  the  hard  surface) 
for  positive  g;  therefore,  the  renoval  of 
air  from  the  seat  is  the  most  important 
and  most  difficult  to  achieve  due  to  the 
low-pressure  differential.  Figure  7 shows  a 
pressurization  time  (decreasing  g)  of  45 
milliseconds  and  a bleed  time  (increasing  g) 
of  60  milliseconds  for  a 50?  step.  Both 
positive  and  negative  steps  have  settled 
to  within  101  of  the  final  value  in  100 
milliseconds.  Analysis  of  the  step  and 
sinusoidal  responses  show  that  the  system 
is  essentially  a .45  damped,  25  rad/sec, 
second  order  system  over  the  range  of  0 to 
8 Hz.  This  provides  a 35  mi  1 1 1 second  time 
lag  from  seat  conmand  to  seat  pressure  over 
the  seat's  full  range  of  operation.  The 
dynamic  response  data  is  summarized  in 
Table  I. 


A complete  seat  pan  was  installed  in 
NASA  Langley's  Differential  ’'laneuvering 
Sin'ulator  (DMS),  Figures  8 and  9,  which  is 
described  in  Meference  3.  The  DMS  has  a wide 
l.U.V.  visual  display  where  all  servos 
involved  in  projecting  the  visual  scene  are 
synchronized  with  a .7  daniped,  25  rad/sec, 
second  order  transfer  functions.  The  initial 
step  in  the  developrent  of  the  complete 
seat  drive  signals  was  to  drive  the  seat  pan 
with  normal  acceleration.  7\dditional  tenns 
for  other  cues  are  to  be  added  one  at  a time. 
For  the  nornal  acceleration  drive,  the  seat 
cells  were  subjectively  scaled  using  6 LHC 
test  pilots  anu  2 engineers.  The  scaling 
(Figure  10)  was  developed  by  the  test  pilots 
and  engineers  making  comparison  flights  in 
the  LRC  T-38  aircraft.  Note  that  the  two 
forward  cells  are  driven  over  a smaller 
pressure  range  than  the  two  rear  cells.  This 
is  due  to  the  fact  that  the  pilot's  feet, 
resting  on  the  rudder  pedals,  do  not  allow 
his  upper  legs  ‘o  fall  as  hij  torso  does. 

Also  note  (Fig.  IC)  that  no  cells  arc  driven 
to  zero  differential  pressure  in  order  to 
prevent  the  false  cue  of  the  seat  falling 
away  from  the  pilot's  legs  and  sides  of  the 
buttocks.  The  scaling  chosen  allows  maximun 
"feel"  at  +6g  and  Og  with  the  Ig  neutral 
position  biased  (as  a function  of  pilot 
weight, Figure  11)  to  allow  the  pilot's 
tuberosities  to  just  contact  the  hard 
surface  as  described  earlier.  This  scaling 
was  found  to  give  good  pilot  sensitivity 
to  small  "g"  increments  while  perforn'ing 
tracking  tasks  as  well  as  providing  "ad 
overall  feel  at  the  maximum  "g"  lev 

Initial  Perfonnance  Tests 

Following  the  scaling  of  the  normal 
acceleration  drive  term,  an  experiment  was 
defined  to  detemrrine  the  effect  of  the  g-seat 
(driven  by  normal  acceleration  only)  on  the 
simulator  pilot's  performance.  The  experiment 
consisted  of  a tracking  task  with  the 
pilot's  tracking  reference  (a  standard 
reticle  pattern)  driven  by  a square  wave. 

The  studies  were  conducted  in  the  DMS  using 
an  F-14  simulation  as  the  test  aircraft. 

The  pilot's  task  required  tracking  a maneuver 
(at  a constant  range  of  1500  ft)  flown  by 
one  of  the  test  pilots  and  stored  on  permanent 
riles  for  computer  playback.  This  provided 
a repeatable  task  for  evaluation  of  the 
pilot's  performance  with  and  without  the 
g-seat.  The  target  maneuver  consisted  of  a 
3g  wind  up-turn  at  a constant  airspeed  of 
325  knots.  The  pilot's  tracking  reference 
(reticle)  was  driven  during  each  run  from 
10°  lead  to  5°  lag  and  vice-versa  every  10 
seconds.  This  caused  the  pilot  to  reacquire 
the  target  every  10  seconds  (Figure  12) 
increasing  and  decreasing  "g"  from  the  3g 
nominal  point,  ’^he  reticle  was  equipped  with 
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a staiiJarcJ  ranye  analog  tar  scalocl  for  1500 
fei't  at.  tiiL  C o'clock  tab.  This  provided 
rar.jo  inton  ation  to  aid  ttie  pilot  in 
aintaininy  a 1500  foot  ramje  to  the  target 
tf  rojyhoot  the  run.  For  data  analysis 
purposes,  the  tracMny  tasF  is  broken  down 
into  four  Lasic  parts  as  shown  in  figure 
IJ.  These  parts  are;  (1)  transitioning 
froHi  -lo'^  (leau)  reticle  setting  to  +5^  (lay) 
reticle  setting  (+T),  (2)  tracking  at  +5“ 
reticle  setting  (+5),  (3)  transitioning  from 
♦50  reticle  setting  to  -10°  reticle  setting 
(-T),  and  (4)  tracking  at  -10°  reticle 
setting  (-S).  The  pilot  is  considered  to 
have  transi  tiotied  when  the  vertical  tracking 
error  (TkF)  readies  80“  of  the  required  value 
(-10°  or  +5°).  Lach  data  run  lasts 
appronii:  ately  70  seconds.  At  the  beginning 
of  a run  there  is  a 10  second  period  for 
the  pursuit  craft  to  stabilize.  The  70 
second  data  runs  alternate  seat-on,  seat-off 
conditions  and  the  runs  are  grouped  into 
sessions.  One  session  consists  of  10 
sixt>-second  runs,  five  with  seat-on  and 
five  wi th  seat-off. 

Statistical  Performance  and  7^nalyses  Measures 

During  eacii  oata  run,  eleven  system 
states  are  recorded  every  1/lo-second. 
Variables  recorded  (raw  data)  are  vertical 
tracking  error  (TKF),  lateral  tracking  error 
(TKL),  total  tracking  error  (TKC),  normal 
acceleration  (N2),  pitch  rate  (THLO),  roll 
rate  (i’JT),  ranye  to  target  (RT),  reticle 
cor»'iand  (Rtl),  stick  deflection  for  pitch 
(OL),  stick  deflection  for  roll  (DA), 
rudder  deflection  (DR),  reticle  switching 
time  (SWT)  and  time  (T).  This  raw  data 
is  then  transfonned  to  perfoniiance  measures. 

In  order  to  create  the  performance 
reasures  , lour  measurement  calculations  are 
used.  They  are  the  arithmetic  mean,  root 
mean  square,  maximum,  and  minimum.  These 
calculations  are  applied  to  the  four  basic 
parts  of  fhe  reticle  switch  cycle  and  the 
eleven  system  states.  Performance  measures 
Such  as  mean  normal  acceleration  during  a 
positive  transition  from  -10°  to  +5° 

(MNZ+T),  mean  normal  acceleration  during  a 
negative  transition  from  +5°  to  -10°  (MNZ-T) 
and  mean  normal  acceleration  during  a positive 
tracking  (MNZ+S)  are  available  from  the 
program.  Also,  the  positive  transition  times 
(TS+)  and  the  negative  transition  times 
(TS-)  are  used  as  performance  measures. 
Altogether  ninety  performance  measures  were 
created  and  analyzed  to  determine  whether 
the  g-seat  affected  pilot  performance. 

In  order  to  analyze  the  performance 
measures,  two  statistical  tests  were  used. 

They  were  the  student's  t-test  for  paired 
and  unpaired  data  and  the  variance  ratio 
test.  In  addition  to  these  tests  , other 
pertinent  statistical  parameters  computed 


included:  ^^ean  values  for  seat-on  and 
seat-off  conditions,  variances  for  seat-on 
and  seat-oif  conditions,  total  variances,  and 
correlation  matrices. 

Presentation  of  the  Results 

Two  sets  of  pilots  were  used  in  this 
study.  The  first  set  contained  two  Langley 
test  pilots  with  many  hours  in  fighters 
and  in  simulators.  These  two  test  pilots 
v;tre  used  to  scale  the  g-seat  and  as  a 
result  were  very  experienced  with  the  g-seat 
and  the  simulator.  Tiie  second  set  contained 
five  NASA  test  pilots  with  varying  degrees 
of  time  in  fighter  aircraft  and  little 
famialiarity  with  the  DMS  and  g-seat.  The 
first  set  of  pilots  flew  7 sessions  per 
pilot  for  data.  The  first  two  of  which  were 
not  used  to  ensure  that  the  pilots  were  far 
along  learning  curves.  The  second  set  of 
pilots  flew  4 sessions  per  pilot  for  data. 

Ttie  first  two  of  which  were  not  used  as 
before.  None  of  the  5 pilots  in  this  group 
had  flown  the  task  before  the  study  began 
A large  sample  of  pilots  (4  or  more)  with 
about  7 sessions  of  the  experiment  would 
have  been  the  ideal  situation,  but  due  to 
the  limited  number  of  Langley  test  pilots 
and  their  busy  work  schedule,  this  was  not 
possible.  Hence,  two  samples  were  used;  a 
small  sample,  set  one,  with  many  sessions, 
and  a larger  sample,  set  two,  with  fewer 
sessions.  The  pilots  in  both  sets  used  a 
wide  variety  of  approaches  to  tracking  the 
target.  This  variation  can  be  seen  by 
looking  at  the  average  transition  times  for 
each  pilot  shown  in  Table  2.  Some  pilots 
used  a near  maximum  aircraft  pitch  rate  to 
transition  which  resulted  in  large 
overshoots/undershoots  and  larger  oscil la- 
tions  about  the  desired  tracking,  while 
others  transitioned  much  slower  to  ensure 
much  smaller  overshoots/undershoots  and 
better  steady. state  tracking.  Thus,  the 
pilot  samples  cover  a large  range  of 
approaches  to  the  task. 

Table  3 presents  a summary  of  the 
analysis  for  the  2-pilot  set  and  Table  4 
presents  a sunriary  of  the  analysis  for  the 
5-pilot  set.  Contained  in  the  table  are  the 
results  of  the  variance  ratio  test  for 
seat-on  variances  versus  seat-off  variances 
and  the  two-sided  students-t  test  on  paired 
data.  The  probabilities  listed  are  those 
of  the  event,  "the  difference  between 
seat-on  and  seat-off  is  not  due  to  chance." 
One  minus  any  of  the  probabilities  will  give 
an  a-level  at  which  the  test  result  is 
considered  significant.  Only  probabilities 
greater  than  or  equal  to  .9  are  listed.  A 
computer  subroutine  was  used  to  calculate 
the  probabilities  from  an  f-di stribution  and 
a t-distribution.  Round-off  and  truncation 
error  results  in  some  probabilities  being 
given  as  1.000.  The  arrows  beside  the 
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probabilities  indicate  whether  the  measures 
tested  were  lower  (i)  or  higher  (t)  for  the 
seat-on  condition.  It  is  considered  impor- 
tant that  over  90!  of  the  significant  measures 
for  both  pilot  sets  combined  have  lower 
variances  for  the  seat-on  condition.  This 
would  indicate  that  the  pilot  gets  information 
from  the  seat  which  allows  more  precise 
control  of  his  aircraft,  thereby  lowering 
the  variance  of  soice  perfoniiance  measures. 

Tne  pilots  were  each  reguired  to  fill  out 
a guestioni  a I re  (fig.  14)  concerning  the 
realism  of  the  seat  and  any  effect  they  thought 
the  g-seat  had  on  their  perfonnance.  The 
tO'irenis  giver.  Py  each  pilot  indicated  that 
they  thought  that  they  handled  the  airplane 
rore  gently  with  the  seat  on.  This  appears 
to  be  verified  by  the  results  of  statistical 
tests  on  the  longitudinal  measures  which  show 
lower  near,  values  for  aircraft  parameters 
.pitch  rate,  nortT;al  acceleration,  longitudinal 
stick  position)  and  generally  higher  means 
for  the  longitudinal  performance  r.easures 
.vertical  tracking  error  and  transition  time). 
Tne  pilot's  comments  also  indicated  that  the 
aircraft  appeared  to  be  "easier  to  control" 
or  "better  damped"'  in  roll  with  the  seat  on. 
Tris  can  be  seen  in  the  data  which  shows  a 
large  r.uii.ter  of  significant  measures  in  the 
variances  and  n.eans  for  tne  lateral - 
directioi.cl  neasures;  even  tnougti  the  task 
was  essentially  vertical  tracking.  Tne 
lateral  p-xiblen  seers  to  come  from  the 
pilots  li.aring  lateral  corrections  to  track 
tne  target  aircraft  and  consequentially 
being  "out  of  plane"  with  the  target  when 
transitioning.  The  seat  appears  to  be 
providing  (through  the  noniial  acceleration 
drive  signal)  infomation  wnich  n.akes  it 
easier  to  ' a^e  tne  lateral  corrections,  i.e., 
sensing  the  out  of  plane  accelerations  more 
rapidly.  ..trier  pilot  comments  indicated 
good  to  e/cellerit  realism  for  trie  normal 
acceleration  cues.  None  of  the  pilots 
considered  that  the  seat  had  any 
noticeable  ti-,e  lag. 

Concl usi ons 

Objective  (statistical  test  results)  and 
Subjective  (pilot  coijients)  evaluations  of 
the  effect  of  trie  g-seat  on  pilot  perfor- 
■ ance  durir.g  a tracking  task  indicates  that 
tne  g-seat  does  affect  trie  perfor’iance  of 
th(-  ,■  ar/n  acriine  systei  . Tne  g-seat  gives 
infor  atior.  tr.at  allows  more  precise  control 
of  tne  aircraft.  Tnis  is  shown  by  significant 
differerices  in  the  variatices  of  many 
response  n.easures  for  seat-on  versus  seat-off 
conditions  and  over  901  of  the  response 

neasures  tr.at  Jo  Stiow  a sigrii  ficarit  difference 
nave  a lower  variance  for  the  seat-on 
condition.  This  is  further  supported  by 
pilot  conrents.  A surprise  result  was  the 
positive  effect  the  g-seat  had  on  lateral 
control  problen.s.  Again  the  objective  and 


subjective  evaluations  supported  each  other. 
Pilot  comment  said  that  the  aircraft  appeared 
to  be  easier  to  control  or  better  damped  in 
roll  with  the  seat-on.  Again,  significant 
differences  in  the  means  and  variances  of 
lateral  response  measures  implied  that  the 
g-seat  supplied  information  that  aided 
lateral  control  of  the  simulated  F-14 
aircraft.  Analysis  of  the  data  from  this 
experiment  is  continuing.  Tests  to  determine 
the  pilot  describing  functions  for  the 
seat-on  and  seat-off  conditions  are  planned. 
Tile  seat  and  back  drive  equations  are  being 
modified  to  drive  the  g-seat  systen  as  a 
function  of  normal  acceleration,  roll 
acceleration,  directional,  and  longitudinal 
accelerations. 
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TABLE  I.  SEAT  CUSHION  DYNAMIC  RESPONSE 
CHARACTERISTICS 


Conniand 

Maximum  Time  Lag 

SO'  Step 

65  mi  1 1 i seconds 

Full  Ar;plitude 
Sinusoidal  Response 

35  mill iseconds 
Constant  over 
(0  - 8 iu) 

TABLE  2.-  pilot  TRANSITION  TIMES 
r ■ ' ‘ ; 

I I Average  Transition  Time  j 

I seconds  | 


PILOT  ' 


^(lA)  ■ 

TS+ 

3'.  77 

IS-.. 

4.26 

wr 

TS+ 

4.03 

-JG- 

5.09  . 

7TU7" 

TS+ 

3.50 

’fs- 

W) 

TS+ 

3.47 

' TS- 

3.61  ■ 7 

:(3B} , 

TS+ 

2.95 

J 

2,96 
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TABLE  2.  Concluded. 


Average  Transition  Time 
seconds 

[PILOT 

!r4B)_ 

TS+ 

1 .97 

TS- 

T.94 

- -- 

^5B) 

TS+ 

2.T1 

1 I TS-  . . 

2.18 

TABLE  3{a).  Continued. 


- Variance  less  seat-on 

- Variance  more  seat-on 

Measures 

Probability 

Lateral 

\ 

MDA  -S 

.956* 

IM  MIN-S 

.998» 

TABLE  3(a).  SIGNIFICANT  VARIANCES  FOR  THE  TWO- 
PILOT  SAMPLE 


I - Variance  less  seat-on 
I - Variance  more  seat-un 


Measures 

- 

Probabi 1 i ty 

TS+ 

.962»  I 

1 

* +T 

Longi  tudinal 

t ^ - 

1 MTK  +T 

.949  ♦ 

L 

-T 

Long! tudina' 

: 

.57r» 

MTO  -T 

.995  » 

MNZ-T  ^ 

.976  ♦ 

'“to  MIN-T 

.999« 

1 NZ  MIN-1 

T.OoSf  " ^ 

t-  - -- 

Lonqitudina' 

i 

' MDE  +S 

^ .955  * ^ 

1 TO  MAX  +S 

.9l3T  J 

I NZ  MIN  +S 

.943* 

r ■ 

" -s' 

Lonqitudina' 

[■■■■■  - - -- 

TO  MAX  -S 

^ .929» 

rr:._..  _ ..  ^ 

[ +T 

Literal 

— 

MPOt  +T 

.926  1 

; POT  MIN  +T 

1.000* 

; POT  MAX  +t 

1.000  * 

. ^ 

-T 

Lateral 

f ( 

^ MDR  -T 

.995* 

MTKL  -T 

.932* 

MPOT  -T 

.991  ♦ 

POT  MAX  -T 

.968* 

+S 

Lateral 

MDA  +S 

.993  * 

MPOT  ♦S 

.996  * 

PBt  MAX  +S 

|. 

.993  ♦ 

TABLE  3(b).  SIGNIFICANT  MEANS  FOR  THE  TWO- 
PILOT  SAMPLE 


j 1 - Mean  less  seat-on 

^ - Mean  more  seat-on 

1 Measures 

Probability 

1 

L JS+  . 

- 

TS-  _ 

.972  » 

L . . 

■ -T 

Longi tudinal 

MDE  -T 

.998* 

MTD  -T 

.958* 

TD  MAX  -T 

.918* 

-S 

Longi tudinal 

MTK  -S 

.970* 

NZ  MAX  -S 

\ 

^ •993*  . 

TO  MIN  -S 

L .9?j*  T 

, NZ  MIN  -S 

; .997  * 1 

Lateral 

h ■ 

, POT  MIN  +T 

.980  f 

i POT  MAX  +T 

^ .987 f 

: -T 

Lateral 

I 

MOR  -T 

.958  * J 

l:.-'  . : 'J 

f ----  -1 

+S^ 

Lateral 

] 

POT  MAX  +S 

. .992*  . J 

-S 

Lateral 



MTKL  -S 

.985*  1 

POT  MAX  -S 

.965*  1 
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TARLL  ^(a).  SIGNIFICANT  VARIANCES  FOR  THE  5- 
PILOT  SAMPLE 


^ 5 PILOTS  MIXED 

1 

1-  Variance  less  seat-on 
Variance  more  seat-on 

1 Measures 

frobability 

TS+ 

TS- 

.918  t 

. 

Longitudinal 

MTK  +T. 

,921 1 ; 

; 

Longitudinal 

1 

; MDE  +s 

.971*  ^ 

L 

Longi tudinal 

UTK  -1 

" ~972t  : 

r“ 

Lateral 

^ * MCA  +T 

.971 t 

I PUT  MAX  ♦T 

.929t 

r 

; ■ -T‘ 

Lateral. 

MOA  -T 

.960» 

;■  POT  MIN  -r 

;__.965* 

} 

L 

Lateral 

r . ‘ ^ 

; _ PUT  MIN  +5 

•987t 

- - 

Lateral 

■ MTKL  -S 

.99^ 

' PDT  MAX  -S 

_^8  ♦ , 

’ PDT  MIN  -S 

.967  « ] 

TACLE  4(b).  SIGNIFICANT  MEANS  FOR  THE  5- 
PILOT  SAMPLE 


'S  PILOTS  MIXED 

1 - Mean 
^ - Mean 

less  seat-on  | 
more  seat-on i 

Measures 

Means 

0-60  sec 

Prob.  1 

, 

-T 

Lonqi tudinal 

TO  MAX  -T 

.973  * 

+T 

L Lateral 

1 

MDR  +T 

.930  ♦ 

-T 

Lateral 

h 1 

^ - i 

: MDA  -T 

.963  » 

-S 

Lateral 

MDR  -S 

.930  * 

MPDT  -S 

__.970» I 

/ Wood 


(a)  Neutral  - Ig  Bias 


Pilot' s Buttocks 

a<t*^  — Air 

y / >7  7 V /’/’/>  /■  / />  /V  ///////  / : 


jood 


(b)  Positive  g 


Figure  2.  Seat  Operation 
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100  psi  Air  Supply 
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Figure  5.  Seat  Cushion  Bottom  View 
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Aik  TO  srAT  C0MPAR'’-'L 


LI  MAR  MOTOR 


Input,  Volts  Seat  Pressure,  Input,  Volts  Seat  Pressure, 

N/m*'  X lO^(psi)  N/ra^  x lO^(pdi) 


Kip,iire7a.-  Ni-Rativi*  g Response 


0 100  200  300 


Figure  7b.-  Positive  g Response 


Figure  7 


G-St;at  Step  Response  for  50%  Step  Input  (1  cell) 


.28 


I’K-asf  nutc-  the  realism  of  the  seat  on  the  scale  below: 


Does  the  presence  of  the  seat  have  any  effect  on  your: 


i) 

Overall  Tracking  performance? 

YES 

NO 

a.  over  shoot 

YES 

NO 

b.  time  to  stabilize 

YES 

NO 

2) 

Control  inputs? 

YES 

NO 

3) 

Maximum  A/C  rates? 

YES 

NO 

is  there  any  noticeable  time  In^  in  the  seat  response  to  your  inputs? 

YKS  NO  

Additional  Comments: 

Figure  13.  Pilot  Questionnaire 
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SIMUtATOR  TKAtNINr,  AND  P|  ATFORM  MOTION  IN 
AIR-TO-SIIRI  ACf  WIAPON  DIIIVFRY  TRAINING 

DR.  THOMAS  H.  GRAY  and  MAJOR  ROBERT  R.  FULLER.  USAF 
Flvinq  Traininq  Division,  Air  I orcn  Human  Resources  Laboratory,  Williams  AIR,  Arizona 


SUMMARY 

The  objectives  ot  this  research  were  to 
determine;  (1)  the  extent  to  which  qeneral- 
ized,  conventional,  a i r-to-surface  (A/S)  wea- 
pons delivery  traininq  in  the  Advanced  Simu- 
lator for  Pilot  Traininq  (ASPT)  transferred 
to  a specific  aircraft;  (?)  the  contribution 
of  six  deqree  of  freedom  platform  motion  to 
the  transfer  of  traininq  from  simulator  to 
aircraft;  and  (1)  the  differential  effects, 
if  any,  of  this  simulator  traininq  on  student 
pilots  of  different  ability  levels.  These 
objectives  were  accomplished  by  selectinq  24 
students  in  the  lead-in  A/S  traininq  course 
at  Holloman  AFB  to  serve  as  subjects.  These 
subiects  proqressed  throuqh  lead-in  traininq, 
receivinq  all  traininq  except  the  A/S  fliqhts, 
and  then  proceeded  to  Williams  AFB  where  they 
were  assiqned  into  matched  experimental  and 
control  qroups.  At  Williams  AFB,  all  of  the 
subiects  received  academic  traininq  in  wea- 
pons delivery  techniques  and  procedural  train- 
inq on  c-SB  operations.  At  this  point,  the 
students  in  the  control  qroup  flew  two  data 
collection  sorties  in  the  F-SB  aircraft,  per- 
forniinq  10°,  1S°,  and  ?0°,  bomb  del  f ver tes . 

The  experimental  qroujis  received  A/S  weapons 
delivery  traininq  in  ASPT  on  10°,  15°,  and 
30°  bfxnb  deliveries  with  a fixed  number  of 
trials  on  each  event.  The  experimental  sut 
jects  then  received  two  data  collection 
fliqhts  in  the  F-5B  identical  to  those  re- 
ceived by  the  control  qroup.  Analysis  of  the 
results  proved  that  simulator  traininq  siqnif- 
icantly  increased  air-to-surface  weapons  de- 
livery sMlls  (e.q.,  approximately  double  the 
number  of  qualifyinq  bombs,  a one-fourth 
reduction  in  circular  error)  but  that  plat- 
form motion  was  not  a contributiriq  factor  in 
this  process.  It  was  also  found  that  novice 
student  pilots  of  qreater  initial  ability 
benefit  most  fnm  such  simulator  traininq 
when  a minimum  fixed  number  of  trials  is  used. 

BACKf.ROUND 

The  air-to-surface  mission  is  a major 
role  for  the  Tactical  Air  Conmand  (TAG).  A 
specialized  aircraft  is  beinq  procured  to  sup- 
port this  operational  requirement  for  which 
the  Air  Force  plans  extensive  simulator  pro- 
curements in  order  to  reduce  traininq  costs 
while  maintaininq  operational  readiness.  In 
Hqht  of  this  fact,  it  is  hiqhly  desirable  to 
determine  the  effectiveness  of  candidate  sim- 
ulator confiqurations  prior  to  their  acquisi- 
tion by  the  user.  From  the  user's  viewpoint, 
there  are  two  aspects  to  this  process.  First, 
the  simulation  must  provide  the  cues  essential 


for  traininq;  and  second,  there  must  be  posi- 
tive traininq  transfer  from  the  simulator  to 
the  aircraft.  From  a budqetary  standpoint, 
these  two  requirements  are  valid,  but  the 
cost  element  must  be  considered  as  well. 
Unnecessary  features  should  not  be  purchased; 
the  simulation  must  not  only  be  effective, 
but  also  it  must  be  efficient. 

One  expensive  fliqht  simulator  feature, 
of  which  the  universal  essentiality  is  not 
certain,  is  platform  motion.  The  question  as 
to  whether  the  existence  of  simulator  plat- 
form motion  enhances  the  traininq  effective- 
ness of  the  device  is  an  issue  of  consider- 
able importance.  Using  a moving  platform  to 
provide  vestibular  and  kinesthetic  cues  to 
the  pilot  is  a costly  process.  Not  only  are 
initial  expenses  increased,  but  life  cycle 
costs  are  also  inflated.  Unless  some  posi- 
tive traininq  value  can  be  demonstrated  for 
the  presence  of  motion,  cost-avoidance  con- 
sideration must  force  its  exclusion  from  the 
simulator. 

The  Air  Force  Human  Resources  Lab- 
oratory (AFHRL)  recently  participated 
in  a study  (ASD  Project  2235)  which 
facilitated  the  development  of  a visual 
scene  capability  on  the  ASPT  that  included 
a conventional  air-to-surface  weapons 
delivery  complex  and  the  display  of 
tactical  targets  for  more  advanced  opera- 
tional training.  This  visual  capability, 
when  combined  with  objective  scoring  strate- 
gies and  the  existing  motion  system  permitted 
the  investigation  of  the  transfer  of  training 
phenomena  described  in  the  present  study. 

Air-to-surface  weapons  delivery  is  a 
high-risk  area  of  traininq  for  newly  rated 
pilots,  large  Air  Force  expenditures  for 
simulation  of  this  activity  are  imninent. 
Therefore,  a determination  of  both  the  feasi- 
bility of  simulator  traininq  in  this  area  and 
an  assessment  of  the  contribution  of  platform 
motion  to  simulator  effectiveness  in  this 
context  was  deemed  essential. 

Literature  Review.  There  have  been  numerous 
s lud I'e's  i nves t i qa t i nq  the  effects  of  platform 
motion  upon  piloting  tasks.  Many  of  these 
have  been  directed  towards  determining  the 
degrees  of  freedom  required  for  motion  sys- 
tems in  particular  settings  as  well  as  what 
levels  of  fidelity  are  needed  (Bergeron,  1970; 
Jacobs,  Williqes,  Roscoe,  1973).  This  body 
of  research,  however,  is  equivocal,  and 
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finrtinijs  h.ivc  not  .tlway^  tx'on  cnnsistpnt  from 
it'idv  to  sfiidy. 

fprt.iin  studios  huvo  shown  that  motion 
producos  improved  pilot  pert onnanco  in  con- 
trolling the  simulator  (Rorlace,  19/7,  Brown, 
Johnson  and  Mungall,  1960).  In  this  vein, 
Rathert,  Creer,  and  'adoff  (1961)  demon- 
strated that  varying  the  fidelity  of  motion 
Cueing  directly  affected  the  pilot's  perform- 
ance in  the  simulator.  Koonce  (1974)  invest- 
igated the  training  effectiveness  of  platform 
motion  using  three  conditions  of  motion  cue- 
ing (i.e.,  no  motion,  sustained  motion  cueing, 
and  washout  motion  cueing).  This  study  re- 
ported an  increase  in  pilot  perfoimiance  in  the 
simulator  when  ei ther  condition  of  motion  cue- 
ing was  present. 

from  Koonce's  study,  it  's  seen  that  the 
evidence  supporting  the  posi  ive  (‘ffects  of 
high  fidelity  motion  cueing  is  not  firmly 
established.  Demaree,  Norman,  and  Matheny 
(1965)  concluded  that  in  many  instances  the 
level  of  fidelity  could  be  reduced  without  any 
appreciable  performance  decrement  on  tracking 
tasks.  Huddleston  (1966)  reported  that  motion 
may  not  be  necessary  for  those  piloting  tasks 
performed  in  the  more  stable  flight  regimes, 
although  it  may  be  beneficial  in  highly  dynam- 
ic regimes,  finally,  a follow-on  study  to 
koonce  (Jacobs  and  Roscoe,  1975)  may  haye  re- 
vealed a critical  facet  of  the  issue.  It  was 
found  that  pilot  perfoniiance,  in  terms  of 
errors  coirriitted,  improved  in  the  simulator 
with  the  presence  of  either  normal  washout 
motion  or  random  washout  motion  where  the  lat- 
ter condition  provided  appropriate  onset  cue- 
ing, but  random  directional  cueing.  Perhaps 
motion  serves  only  to  alert  the  pilot  to  a 
change  in  system  conditions  and  rarely  has 
any  intrinsic  stimulus  value  beyond  this  point 
(Irish,  Grunjke,  Gray,  and  Waters,  1976). 
Simple  "movement,"  not  complexly  driven  motion 
platforms,  may  provide  sufficient  cues  for 
simulation. 

A plethora  of  studies  attest  to  the 
training  value  of  simulation  (Woodruff  and 
Smith,  1974;  Reid  and  Cyrus,  1974;  Caro,  1970; 
and  Prophet,  Caro  and  Hall,  197?).  But  the 
effectiveness  of  simulator  training  varies 
enormously  when  viewed  across  specific  appli- 
cations, and  it  is  wise  to  pretest  whenever 
possible.  In  addition,  individual  differences 
in  the  student  population  may  produce  widely 
different  effects  of  such  training.  The 
present  study  was  designed  to  investigate 
these  possi bi 1 i ties. 

Problem  Statement.  At  the  present  time,  TAC 
a i r-to-surf'ace  training  is  taught  in  tactical 
aircraft.  An  alternative,  if  denwristra ted 
to  b<*  effective,  is  the  use  of  flight  simula- 
tors designed  with  ai  r-to-surface  capabi  1 i ties. 
A related  issue  is  the  efficiency  of  this 


training  for  student  pilots  of  different 
ability  levels.  If  the  payoff  of  simulator 
platform  motion  does  not  increase  the  train- 
ing transfer  to  the  aircraft,  significant 
reductions  in  the  life  cycle  costs  of  the  de- 
vice could  be  realised. 

Objectives.  The  objectives  of  this  research 
were  to  determine:  (1)  the  extent  to  which 
generalized,  conventional,  a i r-to-surface 
weapons  delivery  training  in  the  A5PT  trans- 
fers to  a specific  aircraft;  (2)  the  contri- 
bution of  six  degree  of  freedom  platform 
motion  to  the  transfer  of  training  from  simu- 
lator to  aircraft;  and  (3)  the  differential 
effects,  if  any,  of  this  simulator  training 
on  student  pilots  of  different  ability  levels. 

MFTHOD  AND  PROCmuRFS 

The  main  theme  followed  throughout  the 
study  was  that  the  approach  should  be  intense- 
ly realistic  in  terms  of  Air  Force  operations. 
This  was  the  determining  factor  in  the  study's 
methodology.  Accordingly,  it  was  decided  to 
select  a homogeneous  group  of  inexperienced 
pilots  who  had  already  been  identified  for 
fighter  training,  train  them  on  specified 
tasks  in  the  simulator,  then  measure  their 
performance  on  the  same  tasks  in  an  aircraft 
on  an  actual  gunnery  range.  The  result  was  a 
simple  study,  easily  and  quickly  understood, 
that  produced  information  directly  applicable 
to  Air  Force  areas  of  concern. 

Subjects.  The  personnel  who  serve  as  subjects 
in  simulation  research  are  usually  found  to 
be  the  major  single  source  of  variance  when 
the  analysis  of  the  experimental  results  is 
completed.  In  this  study,  great  care  was 
taken  to  remove  as  much  of  this  unwanted  var- 
iance as  possible  through  the  use  of  judi- 
cious selection  techniques  and  counterbal- 
anc  i ng. 

l<.,  iu<l  . ' ■■..  It  was 

decided  that  the  most  representative  source 
of  subjects  would  be  recent  Undergraduate 
Pilot  Training  (UPT)  graduates  who  had  been 
identified  for  fighter  assignments.  These 
novice  pilots  receive  a short  six-week 
fighter  lead-in  training  course  at  Holloman 
Air  Force  Rase,  New  Mexico,  after  graduation 
from  UPT  and  prior  to  arrival  at  their 
Replacement  Training  Unit.  The  lead-in  course 
is  designed  to  improve  foniiation  flying  skills 
and  to  provide  an  introduction  to  high  per- 
fonnance  maneuvering  and  to  air-to-ground 
weapons  delivery.  At  the  time  of  this  study, 
the  course  contained  19  sorties  in  the  two - 
place  T-3R  aircraft,  the  same  aircraft  flown 
in  UPT. 

The  subjects  were  given  the  entire  lead- 
in  training  course  with  the  exception  of  the 
a i r-to-surface  indoctrination.  This  required 
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il('lcfini)  two  T-3H  sortips  which  woro  repldcpd 
hv  tw('  sorties  in  the  F-^iP  .it  Willidins  Air 
force  Riise  ds  part  of  the  stinly.  The  two 
sorties  deleted  at  Hol  Ionian  Air  Force  Rase  are 
flown  "dry"  since  the  T-3R  does  not  have  the 
capability  to  deliver  ordnance,  whereas  the 
two  F-5B  sorties  gave  the  subjects  the  oppor- 
tunity to  drop  twi'lve  B[)ll-33  practice  boinbs 
which  would  serve  as  criterion  measures.  The 
suhiects  were  randomly  Sf'lecteil  from  those 
meeting  certain  admi ni st ra t i ve  criteria  in 
the  training  squadron  at  Holloman.  The  train- 
iiK)  squadron  then  developed  a rani  orderinq  of 
thc'se  suhiects.  This  ranf  ordering  was  made 
on  the  basis  of  the  studi'nt's  performance  dur- 
ing lead-in  training. 

w '.  Upon  the  completion  of 
le.id-in  training,  the  student  pilots  wer(>  sent 
to  Williams  in  groups  of  six.  It  was  neces- 
sary t'l  use  four  lead-in  training  classes  in 
to  produce  a total  N of  dA  students, 
eight  Mjb.iect'.  acsupied  to  each  of  tlirec' 
groups. 

The  rankings  liven  by  the  squadron  at 
■iollom<in  formed  the  tiasis  for  assigning  each 
•ibiect  into  either  a control  group  which 
received  no  simulator  training,  or  one  of  two 
exper imcuitd  1 groups  (i.e.,  motion  and  no-mo- 
tion qroutis).  for  the  first  class,  the  sub- 
■ects  ranked  1 and  6 were  placed  in  the  motion 
group,  ? and  S in  the  no-motion  group,  and  3 
and  A in  'he  control  group.  Class  two  grouped 
students  and  C into  the  motion  condition,  1 
and  A into  the  no-motion  condition  and  1 and 
f)  were  used  as  control^.  Mass  three  used  the 
last  available  combination  and  class  four  used 
the  first  combination  over  again,  fortunately, 
this  counterba  lane  ing  un  student  perfomiance 
also  produced  groups  that  were  ^^,1]  equated 
from  the  standpoint  of  mear  ixed-wing  flyim) 
time.  The  control  group  averaged  2f)9  hours, 
the  motion  experimental  group  averaged  ?7G 
hours,  and  the  no-motion  experimental  group 
averaged  ?A8  hours.  These  minor  differences 
were  not  Statistically  significant  at  the  five 
percent  level  of  confidence. 

It  is  believed  that  this  procedure  accom- 
plished its  purposes:  namely;  subject  groups 
matched  as  to  ability,  and  a study  that  would 
allow  valid  generalisations  on  the  benefits  of 
a i r-to-surface  simulator  training  to  the  ap- 
propriate Air  force  population. 

Instructor  Pilots.  With  one  exception,  the 
study’s  Instructor  Pilots  were  drawn  from  the 
426th  Tactical  fighter  Training  Squadron 
stationed  at  Williams.  All  Instructor  Pilots 
were  highly  experienced  in  air-to-surface 
weapons  delivery  and  were  thoroughly  briefed 
on  the  purposes  of  the  study  and  their  jobs 
within  it.  Special  training  on  the  ASPT  con- 
sole operation  and  advanced  training  features 
capabilities  was  given  to  the  Instructor 


Pilots  who  administered  the  simulator  train- 
ing. 

A[)paratus.  The  apparatus  used  in  the  study 
consisted  of  two  devices:  the  Advanced  Simu- 
lator for  Pilot  Training  (ASPT)  and,  the 
I -6R  a i rcra f t . 

. The  Advanced  Simulator  for  Pilot  Train- 
ing located  at  the  Air  force  Human  Resources 
laboratory/flying  Training  Division  (AfHPL/fT) 
was  used  for  the  training  portion  of  the  stu- 
dy, Technical  references  for  this  device  are 
found  in  Haqin  and  Smith,  197A;  and  Rust, 

1975,  but  a short  description  follows. 

ASPT  has  two  fully  instrumented  T-37 
cockpits  mounted  upon  s i x-degree-of-freedom 
motion  platforms.  The  synergistic  motion 
system  has  six  active  drive  legs  with  approx- 
imately five  feet  of  vertical  travel  and  four 
feet  of  horizontal  travel.  Displacement  capa- 
bilities include:  pitch  -20  degrees  to  *30 
degrees;  roll  *-22  degrees;  and  yaw  02  de- 
grees. These  displacements  are  intended  to 
provide  initial  (onset)  cues  for  all  maneu- 
vers. The  31-bellow  pneumatic  G-seat  is 
designed  to  provide  more  continuous  cues  than 
the  motion  platform  and  accomplishes  this  by 
the  orderly  inflation  and  deflation  of  the 
bellows  in  response  to  the  requirements  of 
each  particular  maneuver. 

The  ASF’T  visual  system  is  comprised  of 
seven  3b-inch  monochromatic  cathode  ray  tubes 
placed  around  the  cockpit  giving  the  pilot 
*110  degrees  to  -AO  degrees  vertical  cueino 
and  *_160  degrees  of  horizontal  cueing.  The 
computer  generated  visual  scene  has  the  capa- 
bility to  display  information  for  most  perti- 
nent ground  references  (mountains,  runways, 
hangars,  etc.)  within  a 100  square  nautical 
mile  area  of  Williams  AfB.  The  configuration 
for  this  study  included  the  conventional 
gunnery  range  visual  data  base  developed  for 
Project  2235  and  the  depressable  bombing 
sight  (A-37  Optical  Sight  Unit)  installed  for 
that  project  (Hutton,  e_t  aj_. , 1976). 

The  aerodynamic  math  models  driving  the 
simulator  were  those  of  the  T-37  aircraft. 

The  feasibility  of  changing  these  models  to 
increase  the  performance  of  the  simulator 
to  more  representative  airspeeds  and  handling 
qualitites  of  fighter  type  aircraft  was  inves- 
tigated. Estimates  of  that  effort  placed  un- 
acceptable time  delays  on  the  project  which 
would  have  not  allowed  information  to  be  pro- 
vided to  the  using  conriand  within  the  required 
time  frame. 

A major  decision  made  in  establishing  the 
simulator  conf iqurat ion  dealt  with  the  G-Seat. 
The  G-Seat  can  serve  as  a platform  motion  sur- 
rogate by  providing  vestibular  and  kinesthetic 
cues.  If  the  G-Seat  had  been  included  as  an 


83 


tndppt’tuti'nt  viii  i.thlp,  twn  adciitinnal  qrniips 
of  suh.K'Cts  would  havo  beon  nuiuirod  for  the 
oxppr inirnt . Thi5  acfion  would  have  increased 
the  si^e  and  duration  of  the  effort  by  two- 
thirds.  Due  to  the  urgent  demand  for  inriedi- 
ate  information  on  platform  motion  effects, 
a larger  study  was  not  a viable  option.  Con- 
seguently,  it  was  decided  that  the  G-Seat 
would  be  a fixed  study  factor. 

The  fully  operative  motion  condition  was 
chosen  for  the  G-Seat  configuration.  The 
reason  for  this  selection  was  that,  unlike 
motion  platforms,  the  inclusion  of  a G-Seat 
adds  very  little  to  either  the  acquisition  or 
life  cycle  costs  of  a flight  simulator.  Since 
it  seemed  highly  probable  that  all  future 
sophisticated  flight  simulators  would  be  pro- 
cured with  G-Seats,  it  was  believed  that  the 
study  results  would  have  greater  validity  if 
the  G-Seat  were  operative  during  the  simulator 
training  phase. 

f-  . The  aircraft  selected  for  the  criterion 
flights  was  the  F-SB,  primiarily  because  f-SB 
training  is  accomplished  at  Williams  Air  Force 
Base  and  the  proximity  of  instructor  pilots 
and  aircraft  greatly  simplified  this  portion 
of  the  data  collection.  An  additional  reason 
for  its  selection  was  because  it  is  a two-seat 
aircraft  and  two  data  collection  flights  per 
Subject  could  be  scheduled  with  very  little 
checkout  time  in  the  aircraft,  since  an 
instructor  would  be  on  board  to  perform  all 
tasks  not  requirexl  as  part  of  the  Study  (as 
well  as  providing  adequate  flight  safety). 

In  all,  the  F-5B  proved  to  be  an  excel- 
lent choice  as  the  criterion  test  vehicle  for 
measuring  the  ability  of  the  subjects  to  per- 
form a i r-to-surface  weapons  delivery.  The 
flight  characteristics  of  the  F-5B  are  similar 
to  those  of  the  T-38  aircraft  which  the  sub- 
jects had  flown  for  approximately  110  hours 
in  DPT  and  another  20  hours  during  lead-in 
training.  Differences  in  operational  proce- 
dures and  "swi tchology"  were  prebriefed  prior 
to  each  aircraft  mission  and  presented  no 
problems  during  the  data  collection  flights. 

Independent  Variables.  Four  independent  var- 
I'ables  were  used  In  the  study.  The  first  of 
these,  training  conditions,  represents  the 
weapons  delivery  training  received  by  the  sub- 
jects at  Williams  AFB.  There  were  three 
levels  of  this  variable;  no  simulator  train- 
ing (Control  Group);  simulator  training  with 
platform  motion  (Experimental  Group  1);  and, 
simulator  training  without  platform  motion 
(Experinienta  1 Group  2).  The  specific  syllabus 
content  and  student  flow  for  all  three  condi- 
tions will  be  covered  in  a subsequent  section. 

The  second  independent  variable,  coinci- 
dent with  the  first,  was  simulator  platform 
motion.  There  were  two  levels  of  this 


variable:  level  one  used  the  full  six  degree 
of  freedom  platform  motion  available;  for 
level  two  the  platform  was  stationary. 

The  third  independent  variable  consisted 
of  the  weapons  delivery  tasks  performed  by 
the  study  subjects.  Three  different  weapons 
delivery  tasks  were  selected;  the  high-drag 
10  degree  dive  angle;  the  high-drag  15  degree 
dive  angle;  and,  the  30  degree  angle  dive 
bomb. 

The  final  independent  variable,  initial 
flying  ability,  was  chosen  to  give  greater 
experimental  control  and  to  permit  group 
comparisons  on  the  effects  of  simulator  train- 
ing as  a function  of  student  ability.  As 
stated  above,  the  subjects  were  rank  ordered 
by  the  training  squadron  at  Holloman  on  the 
flying  ability  they  demonstrated  during  lead- 
in  training.  This  served  two  purposes; 
first,  it  allowed  counterbalancing  of  sub- 
jects so  that  there  were  matched  groups  in 
the  three  training  conditions;  second,  it 
made  possible  comparisons  on  the  value  of 
simulator  training  betweeii  students  judged 
to  have  greater,  as  contrasted  to  lesser, 
initial  flying  ability. 

Study  Design.  The  design  used  throughout  the 
study  was  an  elementary  two-factor  "mixed" 
analysis  of  variance  classified  by  Lindquist 
(1953)  as  a Type  I design.  The  basic  design 
lent  itself  nicely  to  the  analysis  require- 
ments because  for  two-level  contrasts  (i.e., 
motion  versus  no-mot;on,  superior  versus 
inferior  students),  it  conveniently  collapses 
in  simpler  paradigms.  The  three  weapons  de- 
livery tasks  (i.e.,  10  degree,  15  degree,  and 
30  degree  dive  angles)  comprised  one  factor 
of  this  design,  while  group  associated  inde- 
pendent variables  (i.e.,  conditions  of  train- 
ing,simulator  motion  configurations,  and  ini- 
tial flying  ability)  constituted  the  other. 

The  design  was  used  for  the  many  univar- 
iate analyses  of  variance  performed  on  the 
data  as  well  as  the  two  multivariate  cases. 

Dependent  Variables.  There  were  tv«)  sets  of 
dependent  variables  used  in  this  study,  and 
both  sets  had  two  types  of  measurements  within 
them. 

Ain-r.ifl  /'«or o; ininc' ■ VarJutM'  .. 

Two  classes  of  dependent  measures  resul- 
ted directly  from  student  performance  data 
obtained  during  the  F-5B  criterion  flights. 

The  first  of  these,  bomb  delivery  accuracy, 
were  scores  from  practice  bombs  dropped  on 
the  conventional  gunnery  range  at  Gila  Bend, 
Arizona.  The  second  dependent  variable  based 
on  flying  performance  was  Instructor  Pilot 
ratings.  Instructor  Pilots  flying  with  the 
students  in  the  aircraft  gave  subjective  rat- 
ings on  a scale  of  zero  to  four  on  each  bomb 
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oelivery  attempt  which  were  converted  into 
standard  scores  (mean  of  5)0,  standard  devia- 
tion of  10)  for  analytic  purposes.  These  rat- 
ings covered  overall  flying  performance  in  the 
bombing  pattern  but  excluded  any  consideration 
of  the  actual  bomb  score. 

. (I  r t i:  ■ ; ■ ;«  ;.  h ; f ■.’.i  i . .1  > . 

Similar  to  the  above,  there  were  two 
classes  of  dependent  measures  that  resulted 
from  student  performance  in  the  flSTT.  The 
first  of  these,  bomb  delivery  circular  error, 
is  a measure  comparable  in  every  respect  to 
the  corresponding  measure  observed  during  the 
checkrides.  A scoring  algorithm  in  the  simu- 
lator computer  captured  all  release  parame- 
ters on  each  delivery  and  computed  an  impact 
distance  from  the  target  center. 

Capabilities  of  the  ASPT  were  also  used 
to  record  simulated  flight  parameters  at  the 
moment  of  bomb  release.  Airspeed,  altitude, 
g-load,  heading  and  dive  angle  were  printed 
out  for  each  weapons  delivery.  These  were 
the  parameters  utilized  in  the  multivariate 
analyses  of  variance. 

Syllabus  Development.  The  first  step  in  the 
syllabus  development  was  to  determine  the 
tasi s to  be  flown.  Consideration  of  F-bB  and 
ASPT  capabilities  and  project  objectives  re- 
sulted In  the  selection  of  two  low-angle  bomb- 
ing events  ano  one  high-angle  event.  The  two 
low-angle  events  were  10  and  15  degree  simu- 
lated higiv-drag  deliveries.  The  high-angle 
event  selected  was  the  30  degree  dive  bomb. 

"he  skills  reguired  for  this  event  are  some- 
what different  than  for  the  low-angle  deliver- 
ies because  more  reliance  on  in-cockpit  in- 
struments is  necessary  to  meet  reguired 
release  parameters. 

A prototype  syllabus  was  established  and 
several  experienced  pilots  with  no  previous 
a i r-to-surface  training  were  selected  to  con- 
duct a pretest  of  the  mission  scenarios. 

These  trial  runs  provided  insight  into  the 
amount  of  time  reguired  to  conduct  the  train- 
ing, the  optimum  length  of  each  sortie,  and 
at  the  same  time  provided  experience  in  con- 
sole operations  for  the  instructors  who  would 
be  doing  the  actual  training.  After  several 
n.inor  changes  were  made  to  the  syllabus,  the 
course  of  instruction  was  administered  to  a 
new  UPT  graduate  with  flying  experience  simi- 
lar to  the  actual  subjects.  No  problems  were 
encountered  and  the  seguence  and  instructional 
technigues  were  finalized  prior  to  arrival  of 
the  first  class  of  subjects. 

Sublet  Training.  After  their  arrival  at 
Wi 11 iams  AFE,  Til  of  the  subjects  were  given 
two  blocks  of  "ground  school"  training.  The 
first  block  was  presented  on  the  first  morning 
and  consisted  of  an  introductory  briefing,  an 
overview  of  the  study,  and  a short  phase  re- 
view of  air-to-surface  weapons  delivery. 


At  this  point,  the  control  group  was  sere 
arated  from  the  experimental  groups  and  given 
their  second  block  of  training,  an  orientation 
to  the  F-5B.  This  block  of  training  consis- 
ted of  instruction  on  aircraft  procedures  and 
ended  with  a test  on  critical  action  emer- 
gency procedures  which  were  reguired  knowl- 
edge prior  to  flight.  For  these  subjects, 
the  remainder  of  the  first  day  was  spent  on 
the  flight  line  with  time  in  the  cockpit  to 
familiarize  them  with  armament  procedures  and 
switchology.  These  control  subjects  then 
flew  their  two  data  flights  in  the  F-5B  on 
the  second  and  third  days  (one  flight  per 
day).  The  content  of  the  flights  will  be 
described  in  the  section  on  Testing  Proce- 
dures . 

After  receiving  the  first  block  of 
ground  school  with  the  control  group,  the  ex- 
perimental groups  then  proceeded  with  their 
simulator  training.  They  did  not  receive  the 
second  block  on  F-5B  procedures  until  after 
the  simulator  training  had  been  completed. 

The  syllabus  for  this  training  was  divi- 
ded into  eight,  one-hour  sorties.  A building 
block  approach  was  followed  throughout.  On 
the  first  simulator  mission,  a short  familiar- 
ization flight  was  provided  prior  to  starting 
the  actual  weapons  delivery  training.  During 
this  time,  the  subjects  experienced  the  con- 
trol forces  and  trim  changes  that  would  occur 
over  the  airspeed  ranges  that  were  later 
flown.  Characteristics  of  the  simulator  vis- 
ual system  were  explained  so  the  subiects 
were  well-adapted  to  the  outside  cockpit  en- 
vironment. 

After  the  fu'n  l lari  zat  ion  period,  the 
simulator  was  initialized  to  the  gunnery 
range  for  the  start  of  the  a i r-to-surface 
training.  The  events  were  taught  in  seguence 
starting  with  the  10  degree  dive  angle  task. 
The  delivery  was  introduced  with  a prere- 
corded demonstration  of  the  base  leci  and 
final  approach  portions  of  the  pattern,  ’'he 
student  was  then  reset  to  the  same  starting 
point  and  allowed  to  practice  what  he  had 
seen.  This  part-task  approach  was  selected 
to  take  advantage  of  the  available  advanced 
training  features  such  as  probltmi  freeze,  ini- 
tialization/reset, and  record/playback.  Afta- 
several  trials,  the  student  again  viewed  the 
prerecorded  demonstration.  Tpis  presentation 
was  dynamic  for  all  flight  instruments,  stick, 
rudder,  and  throttles  as  well  as  the  visual 
scene.  The  Student  then  flew  the  part-task 
pattern  again  with  his  own  performance  recor- 
ded. When  this  was  replayed,  he  had  instant 
feedback  which  he  could  use  to  analyze  his 
own  errors,  '"he  Instructor  Pilots  used  the 
problem  feature  frequently  to  stop  the  se- 
quence and  to  point  out  what  the  student 
should  have  been  seeing  and  doing.  Finally, 
the  full  pattern  was  demonstrated  and  taught 
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in  much  the  Scimf>  manner  as  the  part-task  pat- 
tern. 

The  second  and  tiiird  missions  introduced 
the  lb  and  30  degree  tasks  using  the  same  pro- 
cedures. Reinforcement  of  previously  learned 
patterns  was  accomplished  at  several  points 
in  the  missions.  The  Instructor  Pilots  used 
missiOT:  guides  in  order  to  follow  the  seguence 
exactly  on  each  sortie.  Thus,  each  student 
in  the  experimental  groups  received  the  same 
number  of  repetitions  on  each  of  the  three 
bomb  delivery  tasks. 

Testing  Procedures.  Criterion  perfonnance 
tests  were  a(iministered  in  the  F-bR  aircraft 
tor  all  groups  and  in  the  ASPT  for  the  two 
experimental  groups. 

' . fach  subject  flew  flights  in  the 
F-5B.  The  test  profile  was  identical  for 
both  flights  and  consisted  of  a total  of  nine 
bombing  patterns  on  each  flight.  The  F-bB 
carries  six  practice  b<xnbs,  so  with  three 
tasks,  this  resulted  in  the  delivery  of  two 
bombs  per  task  per  sortie.  One  extra  pattern 
was  flown  on  each  task  so  a practice  run  could 
be  accomplished  prior  to  the  two  actual  wea- 
pons del iveries. 

•MjJ.if  • r. . ' . The  last  two  sorties  in  the 
simulator  were  designed  to  give  the  subject 
the  same  profiles  on  the  simulated  range  that 
he  would  fly  on  his  two  aircraft  sorties. 

Fach  delivery  was  graded  using  the  same  wea- 
pons delivery  criterion  measure  used  on  the 
aircraft  data  flights  and  instruction  was  min- 
imal. ior  the  scored  portions  of  those 
flights,  the  winds  were  set  to  represent  con- 
ditions typical  of  the  Gila  Bend  Range. 

Scoring  Procedures.  Although  the  same  general 
approach  was  used,  real-world  occurrences 
naturally  beyond  experimental  control  made  it 
necessary  to  use  slightly  different  scoring 
procedures  for  the  aircraft  criterion  mission"i 

I- 'll  .I  t . Ordnance  dropped  on  the  Gila  Bend 
Gunnery  Range  was  scored  by  observers  posi- 
tiontKl  in  towers  near  the  bombing  target. 

Upon  impact,  a small  powder  charge  in  each 
practice  bomb  discharged  a puff  of  white  smoke 
which  was  easily  visible.  Observers  in  the 
two  towers  used  sighting  transits  to  triangu- 
late the  location  of  the  bomb  impact.  The 
triangulation  readings  were  used  to  compute 
the  distance  of  the  impact  from  the  center  of 
the  target.  These  circular  error  scores  were 
relayed  via  radio  to  the  aircraft  after  each 
event.  Maximum  distance  for  determining  circu- 
lar error  was  300  feet,  with  anything  outside 
this  limit  being  reported  as  unscorable. 

These  bf)mbs  were  arbitrarily  assigned  a score 
of  301  feet  for  purposes  of  analysis. 

Occasionally  a malfunction  prevented  a 


bomb  frtxn  releasing  from  the  aircraft.  These 
“no  release"  passes  were  rated  by  the  Instruc- 
tor Pilots  since  the  pattern  was  flown  hut 
simply  no  bomb  score  was  recorded,  '^his  was 
reflected  in  the  analysis  witii  some  subjects 
having  fewer  total  opportunities  which  were 
adjusted  for  rna thema t ica  1 1 y.  Of  the  total  of 
eight  malfunctions  that  occurred,  there  were 
seven  in  the  Control  Group,  and  one  in  the 
Motion  Ixperimental  Group. 

.■'im.il.it  ,1  y.  t . The  simulator  had  a theoret- 
ically unlimited  number  of  bombs.  Fach  time 
the  pilot  released  a simulated  bomb,  the  in- 
structor received  a graphical  display  of  the 
bomb  impact  on  a cathode-ray  tube  which  depic- 
ted the  target  circle.  He  also  received  a 
printout  of  the  exact  parameters  so  he  could 
analy^e  and  critigue  the  subjects'  perform- 
ance. Since  the  computer  was  scoring  the 
bombs,  there  were  none  recorded  "unscorable." 
No  release  malfunctions  occurred  during  the 
simulator  training. 

RFSULTS 

The  research  performed  in  this  study 
addressed  three  objectives  which  may  be  simp- 
lified into  the  following  questions: 

1.  Does  simulator  training  improve  air- 
to-surface  weapons  delivery  skills  in  novice 
pilots? 

2.  Does  simulator  platform  motion  con- 
tribute to  any  degree  to  such  training? 

3.  Does  a fixed  amount  of  simulator 
training  affect  novice  pilots  of  higher  ver- 
sus lower  ability  levels  to  the  same  extent? 

The  hypotheses  tested  in  the  analyses  of 
results  were  taken  directly  from  these  ques- 
tions. Accordingly,  this  section  is  organized 
to  answer  these  questions  in  the  order  in 
which  they  appear. 

Simulator  Training  fffects.  The  analysis  of 
the  ASPT  ’ ra ining  ef i ects  was  based  on  a ser- 
ies of  contrasts  betwern  the  Control  Group 
(C)  and  the  experimental  Groups  (E]  and  r2). 
The  data  collected  made  possible  four  compari- 
sons. The  dependent  variables  used  for  these 
comparisons  were:  number  of  gunnery  range 
qualifying  bombs;  number  of  gunnery  rangr 
scorable  bombs';  gunnery  range  bomb  circular 
error;  and,  Instructor  Pilot  ratings  on  F-5B 
flying  perform<ince. 

t '.’ti.iiiiiiiiii  ikiihh-.  A Chi-Sguare  was 
performed  to  test  for  significant  differences 
in  the  number  of  qualifying  bomb  deliveries 
made  by  the  C and  E groups.  Using  TAC  cri- 
teria, qualification  was  defined  as  a circu- 
lar error  of  105  feet,  or  less,  for  10  degree 
and  15  degree  dive  angles  and  140  feet,  or 


less,  for  the  30  degree  dive  angle.  Both  E 
groups  were  found  to  be  significantly  better 
than  the  C group  at  the  five  percent  level  of 
confidence  =6.99).  Table  1 lists  the  ob- 
served values  and  percentages  for  the  three 
groups. 


TABLE  1 . 

NUMBER  OF  QUALIFYING  BOMBS 
(Training  Effects  Analysis) 


Qualifying  Misses 


Number 

Percentage 

Number 

Percentage 

C 

24 

27% 

65 

73% 

El 

41 

43% 

54 

57% 

Ep 

42 

44% 

54 

56% 

.'iumhor  of  Scorjblc  llombs.  Similar  to  the 
first  analysis,  Chi-Square  was  used  to  test 
for  significant  differences  in  the  number  of 
scorable  (circular  error  of  300  feet,  or  less) 
bombs  delivered  by  the  C and  E groups.  Again, 
the  E groups  were  significantly  better  at  the 
five  percent  level  of  confidence  (x^=7.82). 
Table  2 lists  the  observed  values  and  percent- 
ages for  the  three  groups. 


TABLE  2. 

NUMBER  OF  SCORABLE  BOMBS 
(Training  Effects  Analysis) 

Scorable  Misses 


Number 

Percentage 

Number 

Percentage 

C 

64 

72% 

25 

28% 

El 

82 

86% 

13 

14% 

E2 

82 

85% 

14 

15% 

Br/ffpi  'irr-ui,ir  Using  the  circular  er- 

ror on  bomb  delivery  tasks  in  the  F-5B  air- 
craft as  the  dependent  variable,  a Lindquist 
Type  I analysis  of  variance  was  conducted  to 
compare  the  C and  E groups  on  this  measuri.-. 
The  overall  F value  was  significant  at  the 
five  percent  level  of  confidence  (F=4.39)  and 
a Tukey  Multiple  Comparison  Test  proved  both 
' groups  to  be  superior  to  the  C group  at  the 
same  level  of  confidence.  There  were  no  sig- 
nificant differences  between  the  Ei  and  E^ 
proups , Table  3 lists  the  observed  means  for 
ea' h group  on  the  three  bomb  delivery  tasks. 


TABLE  3. 


BOMB  DELIVERY  CIRCULAR  ERROR  MEANS 
(Training  Effects  Analysis) 


10°  dive 

15°  dive 

3Q°  dive 

angle 

angle 

angle 

C 

200' 

O 

00 

204' 

El 

00 

138' 

169' 

Ep 

138' 

144' 

159' 

Fii/inq  Pot  f orinanco  Hatim/s.  The  same  Lind- 
quist Type  I design  was  employed  to  analyze 
differences  between  the  C and  E groups  where 
the  dependent  measure  was  Instructor  Pilot 
rating  of  F-5B  flying  performance.  Although 
the  E groups  ratings  were  superior  to  those 
assigned  the  C group  at  the  20  percent  level 
of  confidence,  the  F value  was  not  signifi- 
cant at  the  five  percent  level  (F=2.36). 
Table  4 lists  the  mean  ratings  received  by 
each  group  on  the  three  bomb  delivery  tasks. 

TABLE  4. 

FLYING  PERFORMANCE  RATING  MEANS 


(Training 

Effects  Analysis 

) 

10°  dive 

'5  dive 

30°  dive 

angle 

angle 

angle 

C 

44.6 

48.9 

49.4 

El 

52.7 

52.7 

48.3 

E? 

49.4 

52.2 

51.1 

Platform  Motion  Effects.  Considerable  effort 
was  expended  on  the  analyses  of  possible  sim- 
ulator platform  motion  effects.  The  results 
of  all  this  may  be  summarized  at  the  outset 
by  stating  that  none  were  found.  However, 
since  the  issue  is  an  important  one  for  de- 
vice configuration,  the  lack  of  significant 
differences  and  the  extreme  closeness  of  the 
two  experimental  groups  on  the  dependent  mea- 
sures were  of  interest. 

In  addition  to  the  dependent  v riables 
previously  used  for  C and  E groups  contrasts, 
the  simulator  data  were  also  available  for 
analysis.  The  approach  taken  followed  this 
pattern,  analyzing  F-5B  data  first  and  simu- 
lator data  second. 

l/tt'd:  .VuhUiiT  of  QUijIitifjiiq  Oomlis.  A 

Chi-Square  Test  performed  on  the  data  given 
in  Table  1 found  no  significant  differences 
between  the  E-]  and  E?  groups  (x2=.oi).  In 
fact,  when  the  hung  Bomb  on  one  task  is  con- 
sidered, the  scores  of  the  two  groups  are 
identical , 
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F-5B  Data:  Humber  of  Scorahle  Bombs,  A Chi- 
Square  Test  performed  on  the  data  given  in 
Table  2 also  showed  no  differences  between 
the  El  and  E2  groups  (j(2=.03).  Again,  allow- 
ing for  the  hung  bomb  in  the  E]  group,  the 
numbers  are  identical. 

F-5B  Data:  Bomb  Circular  Error,  The  Lind- 
quist Type  I analysis  of  variance  resulted  in 
no  significant  differences  (F=.06)  between 
the  means  of  the  two  experimental  groups  (see 
Table  3). 

F-5/i  Data:  Instructor  I’ilot  Ratings  of  Fly- 
ing Performance,  As  before,  the  analysis  of 
variance  produced  no  significant  differences 
(F=.03)  between  the  means  of  the  E]  and  E2 
groups  (see  Table  4). 

The  analysis  of  the  simulator  training 
data  for  the  motion  and  no-motion  experimental 
groups  also  failed  to  yield  significant  dif- 
ferences. Four  analyses  were  run  on  this 
data.  The  first  analysis  used  bomb  delivery 
circular  error  as  the  dependent  variable  and 
was  performed  to  determine  if  there  was  an 
initial  difference  between  the  two  groups. 

The  second  analysis  used  the  same  dependent 
variable  and  was  conducted  to  see  if  the 
groups  differed  at  the  conclusion  of  their 
simulator  training.  The  third  and  fourth  an- 
alyses paralleled  these  initial  and  final  com- 
parisons but  used  aircraft  delivery  parameters 
(airspeed,  heading,  release  altitude,  G-load, 
and  dive  angle)  as  the  dependent  variables  in 
a multivariate  analysis  of  variance. 

Initial  Circular  Error,  A Lindquist  Type  I 
analysis  of  variance  was  performed  on  the  ob- 
served average  bomb  delivery  circular  error 
recorded  for  each  subject  on  his  initial  six 
attempts  on  each  task  (i.e.,  10,  15,  and  30 
degree  dive  angle).  The  results  showed  no 
significant  difference  at  the  five  percent 
level  of  confidence  (F=.61).  Table  5 lists 
the  observed  means  for  each  group  on  the  three 
bomb  delivery  tasks. 

TABLE  5. 


INITIAL  BOMB  DELIVERY  CIRCULAR  ERROR  MEANS 


(Motion 

Effects  Analysis) 

10°  dive 

15°  dive 

30°  dive 

angle 

angle 

angle 

El 

189’ 

175’ 

151’ 

E2 

151’ 

126’ 

159’ 

na  L 

Ci  rcu  la  I l.i 

rot.  The  same  procedure  was 

used  to  determine  if  the  E^  and  E2  groups  fi- 
nal performance  (eighth  simulator  mission)  on 
these  tasks  differed  significantly.  At  the 
five  percent  level  of  confidence  ,thi s was 
found  not  to  be  the  case  (F=.00).  Table  6 


lists  the  observed  means  for  each  group  on 
the  three  bomb  delivery  tasks. 

TABLE  6. 

FINAL  BOMB  DELIVERY  CIRCULAR  ERROR  MEANS 
(Motion  Effects  Analysis) 


1°  dive 

15°  dive 

30°  dive 

angle 

angle 

angle 

107’ 

104' 

129' 

121' 

86’ ' 

133' 

TnitlaJ  /Ittempt.'S  AJrcraft  DelJvery  Pardmet^jrs, 
The  basic  "groups  by  tasks"  design  was  em- 
ployed for  the  multivariate  analysis  of  vari- 
ance performed  on  aircraft  delivery  parame- 
ters observed  for  the  initial  three  simulator 
missions.  Unlike  the  univariate  cases,  there 
were  five  dependent  variables  analyzed  simul- 
taneousTy.  Rao's  approximation  of  the  F- 
distribution  provided  the  test  of  significant 
(Tatsuoka,  1971).  The  result  was  an  R-value 
of  .28  which  is  not  significant  at  the  five 
percent  level  of  confidence.  The  observed 
mean  differences  from  the  ideal  value  for 
each  aircraft  parameter  are  given  in  Table  7 
for  each  experimental  group  and  task. 

Final  Attempts  Aircraft  Delivery  Parameters » 

The  analysis  of  the  aircraft  delivery  parame- 
ters observed  on  the  eighth  simulator  mission 
was  identical  to  that  used  above.  As  before, 
the  test  for  significant  differences  was  Rao^ 
approximation  of  the  F-distribution,  and  the 
result  was  an  R-value  of  1.63.  This  was  not 
significant  at  the  five  percent  level  of  con- 
fidence. The  observed  mean  differences  from 
the  ideal  value  for  each  aircraft  parameter 
are  listed  in  Table  8 for  each  experimental 
group  and  task. 

Subject  Ability  Levels  and  Simulator  Training. 
It  seemed  reasonable  to  hypothesize  that 
training  in  the  ASPT  would  improve  air-to-sur- 
face  weapons  delivery  skills,  but  an  interest- 
ing corollary  question  is:  who  profits  most? 
Is  such  simulator  training  more  advantageous 
for  the  novice  pilot  of  superior  ability  or 
for  the  novice  pilot  of  inferior  ability? 

Six  analyses  were  performed  to  answer  this 
question.  'The  first  two  of  these  analyses 
were  based  on  data  collected  in  the  simulator; 
the  second  four  used  data  collected  during  the 
aircraft  sorties. 

Simulator  Data.  Using  the  Lindquist  I design, 
two  univariate  analyses  of  variance  were  con- 
ducted to  determine  whether  ASPT  training  was 
more  beneficial  to  the  subjects  rated  as  the 
upper  one-half  or  the  lower  one-half  of  the 
class  from  lead-in  training.  For  these  anal- 
yses, bomb  circular  error  served  as  the  de- 
pendent variable. 
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The  first  analysis  investigated  the  ini-  observed  means  for  each  group  on  the  bomb 

tial  disparity  in  weapons  delivery  skills  delivery  tasks, 

between  the  upper  one-half  and  lower  one-half 
groups.  It  was  rather  surprising  to  find 
that  the  groups  did  not  differ  significantly 
at  the  five  percent  level  of  confidence 
(F=.58).  Table  9 gives  the  observed  means 
for  each  group  on  the  three  bomb  delivery 
tasks  studied. 


TABLE  7. 

INITIAL  AIRCRAFT  DELIVERY  PARAMETERS  (Motion  Effects  Analysis) 


10°  dive 

angle 

1 5°  dive 

angle 

30°  dive  angle 

Heading 

1.57° 

Heading 

2.51° 

Heading 

4.65° 

Altitude 

85.04' 

Altitude 

55.10' 

Altitude 

152.09' 

Ai rspeed 

5.63  kts 

Airs  peed 

5.95  kts 

Airspeed 

6.06  kts 

G-load 

.180 

1.39° 

G-load 

.220 

1.05° 

G-load 

.31q 

1.46° 

Dive  Angle 

Dive  Angle 

Dive  Angle 

Heading 

1.50° 

Heading 

1.66° 

Heading 

3.20° 

Altitude 

110.01' 

Altitude 

67.08‘ 

Altitude 

111.50' 

Ai rspeed 

4.51  kts 

Ai rspeed 

7.55  kts 

Airspeed 

5.11  kts 

G-load 

.14q 

1.63° 

G-load 

.18q 

.83° 

G-load 

.33q 

1.12° 

Dive  Angle 

Dive  Angle 

Dive  Angle 

TABLE  8. 


El 


E? 


FINAL  AIRCRAFT  DELIVERY  PARAMETERS  (Motion  Effects  Analysis) 


10°  dive  angle 


Heading 

1.39° 

Altitude 

82.61' 

Ai rspeed 
G-load 

3.37  kts 

• ^ ^9 
2.02° 

Dive  Angle 

Heading 

1.18° 

Altitude 

95.99' 

Ai rspeed 
G-load 

3.73  kts 
.07q 
2.64° 

Dive  Angle 

TABLE  9. 


15°  dive  angle 


Heading 

1.85° 

AI  titude 

98.71 ' 

Ai rspeed 
G-load 

Dive  Angle 

4.24  kts 
.19q 
.97° 

Heading 

1.40° 

AI titude 

73.11 ' 

Airspeed 

G-load 

8.00  kts 
.15q 
1.09° 

Dive  Angle 

30°  dive  angle 


Heading 

3.21° 

Altitude 

117.57' 

Airspeed 

/.1 6 kts 

G-load 

.25q 

Dive  Angle 

1.05° 

Heading 

4.44° 

AI ti tude 

216.48' 

Ai rspeed 

4.42  kts 

G-load 

.26q 

Dive  Angle 

1.63° 

TABLE  10. 


INITIAL  BOMB  DELIVERY  CIRCULAR  ERROR  MEANS 
(Student  Ability  Analysis) 


10°  dive 

15°  dive 

30°  dive 

angle 

angle 

angle 

Upper 

1/2 

178' 

114' 

152' 

Lower 

1/2 

174' 

185' 

158' 

At  the  conclusion  of  the  simulator  train- 
ing, however,  there  was  a definite  difference 
in  degree  of  skill  shown  by  the  two  groups. 

The  F-value  equaled  3.14  and  was  significant 
at  the  five  percent  level  of  confidence  with 
a directional  hypothesis.  Table  10  gives  the 


FINAL  BOMB  DELIVERY  CIRCULAR  ERROR  MEANS 
(Student  Ability  Analysis) 


10°  dive 

15°  dive 

30°  dive 

angle 

angle 

angle 

Upper 

1/2 

86' 

96' 

110' 

Lower 

1/2 

132' 

94' 

153' 

Aircraft  Data.  Four  analyses  were  run 
using  the  data  from  the  F-5B  sorties  as 
the  dependent  variables.  The  first  analysis 
was  a Chi-Square  test  on  the  number  of 
qualifying  bombs  delivered  by  the  two 
groups.  The  resulting  Chi-Square 
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value  of  1.57  was  not  significant  at  the  five 
percent  level  of  confidence  (Table  11). 

TABLE  11. 

NUMBER  OF  QUALIFYING  BOMBS 
(Student  Ability  Analysis) 

Qualifying  Misses 


Number 

Percentage 

Number 

Percentage 

Upper 

46 

48% 

50 

52% 

1/2 

Lower 

1/2 

37 

39% 

58 

61% 

The  second  analysis  was  essentially  a 
repeat  of  the  first,  except  that  number  of 
scorable  bombs  was  used  as  the  dependent  var- 
iable. Again,  the  Chi-Square  test  was  not 
significant  at  the  five  percent  level  of  con- 
fidence (x2=i.16).  Table  12  gives  the  ob- 
served values  and  percentages  for  the  two 
groups. 

TABLE  12. 

NUMBER  QF  SCORABLE  BOMBS 
(Student  Ability  Analysis) 


Scorable  Misses 


Number 

Percentage 

Number 

Percentage 

Upper 

1/2 

85 

88% 

11 

12% 

Lower 

1/2 

79 

83% 

16 

17% 

When  bomb  circular  error  was  used  as  the 
dependent  variable,  the  Lindquist  Type  I 
analysis  of  variance  resulted  in  an  F-value 
of  .73  which  was  not  significant  at  the  five 
percent  level  of  confidence.  Table  13  gives 
the  means  for  each  group  on  the  three  bomb 
delivery  tasks. 

TABLE  13. 


BOMB  DELIVERY  CIRCULAR  ERROR  MEANS 
(Student  Ability  Analysis) 


10°  dive 

15°  dive 

30°  dive 

angle 

angle 

angle 

Upper 

1/2 

119' 

162' 

143' 

Lower 

1/2 

154' 

133' 

184' 

The  same  design  was  used  to  evaluate  In- 
structor Pilot  ratings  of  F-5B  flying  perform- 
ance for  the  two  groups.  The  resulting  F-val- 
ue  of  1.22  was  not  significant  at  the  five 
percent  level  of  confidence.  Table  14  lists 
the  mean  ratings  received  by  each  group  on 


the  three  bomb  delivery  tasks. 

TABLE  14. 


FLYING  PERFORMANCE  RATING  MEANS 
(Student  Ability  Analysis) 


10°  dive 

15°  dive 

30°  dive 

angle 

angle 

angle 

Upper  1/2 

52.7 

51.1 

52.7 

Lower  1/2 

49.4 

53.8 

46.7 

The  end  result  of  these  four  analyses 
was  tiiat  although  none  individually  reached 
the  five  percent  level  of  confidence,  when 
viewed  collectively,  they  offered  strong  evi- 
dence that  it  was  the  superior  students  who 
gained  most  from  the  simulator  training.  The 
outcomes  of  all  four  analyses  were  in  the 
same  direction.  When  the  actual  probability 
levels  of  the  Chi-Square  and  F-test  were  ta- 
ken into  consideration,  the  level  of  confi- 
dence reached  was  beyond  the  five  percent 
figure. 

CQNCLUSIQNS 

Because  the  study  was  so  basic;  its 
methodology  so  in  conformance  with  typical 
Air  Force  training  operations;  and,  the  re- 
sults so  clearcut;  there  is  little  to  be 
added  to  that  already  presented.  Therefore, 
this  section  will  consist  of  only  a few  brief 
statements  summarizing  simulator  platform  mo- 
tion, and  student  ability  as  a variable  in 
simulator  training. 

Simulator  Training.  The  answer  to  the  ques- 
tion,  "Does  generalized  air-to-surface  simu- 
lator weapons  delivery  training  transfer  to  a 
specific  aircraft?"  is  an  unqualified  yes. 
Perhaps  the  most  important  aspect  of  this  re- 
sult, in  terms  of  its  implications  for  simu- 
lator and  training  program  design,  is  the 
fact  that  the  ASPT  was  configured  as  a T-37 
(with  a sighting  device)  and  still  there  was 
significant  transfer  of  training  to  the  F-5B. 
Although  the  finding  that  a low  fidelity  de- 
vice can  provide  considerable  training  when 
properly  employed  is  not  new  (Prophet  and 
Boyd,  1970),  the  study  was  a rather  striking 
confirmation  of  the  point. 

Platfonn  Motion.  It  is  impossible  to  prove 
the  null  hypothesis,  but  the  results  of  the 
study  show  unequivocally  that  six  decree  of 
freedom  platform  motion  did  not  enhance  the 
training  value  of  the  simulator. 

Considering  the  aerial  weapons  delivery 
task,  this  is  not  a surprising  finding.  The 
task  is  primarily  visual,  and  motion  (or  move- 
ment) serves  only  as  an  alerting  stimulus  to 
the  pilot. 
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This  fact  has  significant  ramifications 
for  simulator  design.  The  deletion  of  plat- 
form motion  reguirements  for  air-to-surface 
simulation  would  have  enormous  cost-avoidance 
consequences.  It  is  believed  that  a G-seat 
and  G-suit  (with  appropriate  stick  and  pedal 
"shakers")  would  provide  all  necessary  "mo- 
tion" cues  needed  for  this  simulation. 

Student  Abi 1 i ty . In  this  study,  it  was  the 
better  novice  pilot  who  profited  the  most 
from  the  ASPT  training.  The  fact  that  the 
better  student  usually  profits  more  when  given 
minimal  fixed  amounts  of  practice  and  receives 
the  greatest  benefits  from  innovations  in 
training  and  education  is  a fairly  common 
observation.  The  same  general  finding  also 
occurs  even  when  the  content  of  training  pro- 
gram syllabus  remains  constant,  but  new  media 
are  introduced  to  convey  this  subject  matter. 
That  the  present  study  was  no  exception  to 
this  general  rule  adds  face  validity  to  the 
results  obtained. 
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PLATFORM  MOTION  AND  SIMULATOR  TRAINING  EFFECTIVENESS 


PAUL  W.  CARO 

Seville  Research  Corporation 


SUMMARY 

Several  recent  studies  reported  that 
simulator  motion  did  not  benefit  subsequent 
flight  performance.  Other  studies  have  re- 
ported various  effects  of  motion  upon  pilot 
performance  in  simulators.  These  possibly 
contradictory  findings  are  examined  in  the 
light  of  recent  distinctions  made  between 
maneuver  and  disturbance  motion.  The  studies 
in  which  simulator  motion  did  not  benefit 
transfer  predominantly  employed  maneuver 
motion  cues,  whereas  the  other  group  of  stud- 
ies incorporated  more  disturbance  motion  cues. 
Pilot  reactions  to  simulator  motion  also  were 
examined  in  terms  of  maneuver  vs.  disturbance 
motion,  and  it  was  noted  that  judgments  of 
the  training  value  of  simulator  motion  were 
related  to  the  maneuver-disturbance  distinc- 
tion. It  is  concluded  that  maneuver  motion 
may  be  of  little  potential  training  value, 
under  many  circumstances,  and  data  necessary 
to  an  adequate  simulation  of  disturbance 
motion  may  not  be  available.  An  analysis  of 
the  training  requirements  associated  with  dis- 
turbance motion  is  needed. 


MOTION  AND  TRANSFER  OF  TRAINING JJUDIES 

Although  motion  simulation  represents  a 
significant  portion  of  the  cost  of  simulator 
procurement  and  operation,  tne  investigation 
of  the  influence  of  motion  upon  transfer  of 
simulator  training  to  operational  aircraft 
has  been  largely  ignored.  There  were  a num- 
ber of  studies  of  simulator  motion  in  rela- 
tion to  aircraft  handling  qualities  and 
control  during  the  1950s  and  1960s,  but  most 
of  them  addressed  transfer  of  training  only 
indirectly.  The  first  significant  published 
transfer  of  training  study  of  the  effective- 
ness of  simulator  motion  upon  subsequent 
perfonnance  in  fligbl  was  reported  in  1975  by 
Jacobs  and  Roscoe. 

Jacobs  and  Roscoe  reported  that  pilot 
performance  in  the  aircraft  did  not  benefit 
from  the  presence  of  normal  washout  cockpit 
motion  ui  the  simulator.  In  that  study, 
training  received  in  the  GAT-2  in  a two-axis 
(pitch  and  roll)  normal  washout  motion  condi- 
tion, compared  with  training  in  the  same 
device  withotif  motion,  resulted  in  non- 
significant differences  in  amount  of  transfer 
to  the  aircraft  for  those  two  conditions. 
There  was,  however,  sirjnifiiant  positive 


transfer  for  both  motion  and  no-motion  con- 
ditions. Similar  results  have  been  obtained 
in  a U.S.  Air  Force  undergraduate  pilot 
training  study  involving  the  more  sophisti- 
cated six-axis  motion  system  associated  with 
the  Advanced  Simulator  for  Pilot  Training 
(ASPT)  (Woodruff,  1976). 


MOTION  AND  SJ^ULATOR  PERF0RMANa_  STUDIES 

The  findings  in  these  two  recent  stud- 
ies that  the  presence  of  motion  did  not  in- 
crease simulator  training  effectiveness  is 
of  considerable  interest,  since  there  are 
other  studies  showing  that,  at  least  under 
some  circumstances,  motion  does  influence 
simulator  training.  For  example,  Fedderson 
(1962)  reported  a slight  advantage  in  favor 
of  a motion  simulator  trained  group  over  a 
no-motion  group  during  brief  transfer  trials 
hovering  a helicopter.  More  importantly, 
perhaps,  the  motion  group  in  his  study 
reached  asymptotic  performance  in  the  simu- 
lator more  rapidly,  suggesting  that  simula- 
tors with  motion  may  provide  more  efficient 
training.  A recent  U.S.  Air  Force  study  of 
pilot  responses  to  engine  failure  in  a simu- 
lated transport-type  aircraft  found  that 
training  is  more  effective  when  motion  is 
added  to  a simulator  with  a visual  display 
than  when  the  same  simulator  and  visual  are 
used  without  motion  (DeBerg,  McFarland,  & 
Showalter,  1976). 

Further,  there  is  evidence  that  pilot 
performance  differs  as  a function  of  the 
presence  or  absence  of  motion.  For  example. 
Perry  and  Naish  (1964)  found  that  pilots 
respond  to  external  forcing  functions  such  as 
side  gusts  more  rapidly,  with  more  authori- 
ty, and  in  a more  precise  manner  in  a simu- 
lator with  motion  and  visual  cues  than  when 
only  visual  cues  are  present.  NASA  research- 
ers (Rathert,  Creer,  S.  Sadoff,  1961)  found 
that  the  correlation  between  pilot  perform- 
ance in  an  aircraft  and  in  a simulator 
increased  with  the  addition  of  simulator 
motion  cues  where  such  cues  help  the  pilot 
in  coping  with  a highly  damped  or  unstable 
vehicle  or  a sluggish  control  system,  or 
under  some  circumstances,  where  the  control 
system  is  too  sensitive.  Where  the  aircraft 
is  easy  to  fly,  however,  as  is  the  case  with 
the  aircraft  used  in  the  Jacobs  and  Roscoe 
study  (Piper  Cherokee)  and  in  the  Air  Force 
ASPT  study  (T-J7),  motion  may  have  no  effect. 
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In  another  NASA  study  (Douvillier,  Turner, 
McLean,  & Heinle,  I960)  of  the  effects  of 
simulator  motion  on  pilot's  performance  of 
flight  tracking  tasks,  the  results  from  a 
moving  base  flight  simulator  resembled  the 
results  from  flight  much  more  than  did  those 
from  a motionless  simulator.  In  a British 
study,  Huddleston  and  Rolfe  (1971)  reported 
that  the  presence  of  simulator  motion  pro- 
duced patterns  of  control  response  more 
closely  related  to  those  employed  in  flight. 
That  is,  using  simulators  without  motion, 
experienced  pilots  were  able  to  achieve  ac- 
ceptable levels  of  performance,  but  their 
patterns  of  control  response  showed  that 
their  performance  was  achieved  using  a stra- 
tegy different  from  that  used  in  a dynamic 
training  environment.  Research  at  the  Uni- 
versity of  Illinois  related  to  instrument 
display  design  found  that  the  quality  of  the 
simulator  motion  involved  affected  pilot 
responses  to  display  types  differentially, 
with  inappropriate  banking  motions  interfer- 
ing with  command  flight  path  tracking  (Ince, 
Williges,  & Roscoe,  1975). 

Thus,  numerous  studies  provide  evidence 
that  the  presence  of  motion,  i.e.,  movement 
of  the  platform  upon  which  the  simulator 
cockpit  rests,  does  affect  performance  in  the 
simulator.  Not  only  can  motion  affect  learn- 
ing rates,  but  the  performance  of  the  pilot 
in  the  presence  of  motion  may  be  different 
than  it  would  be  in  the  absence  of  motion. 

With  motion,  his  simulator  control  responses 
to  external  forcing  functions  appear  to  be 
more  rapid  and  accurate  and  more  like  res- 
ponses used  to  control  the  aircraft  in  flight. 
While  it  cannot  be  concluded  from  these  stud- 
ies that  simulator  motion  during  training 
will  enhance  subsequent  performance  in  the 
aircraft,  they  do  suggest  that  simulator 
motion  can  affect  the  acquisition  of  skills 
in  the  simulator.  These  effects  of  motion 
upon  performance  in  the  simulator  have  been 
demonstrated  under  controlled  experimental 
conditions  that  tend  to  make  it  unlikely  that 
the  noted  differences  in  performance  could  be 
attributed  solely  to  factors  other  than  the 
presence  of  motion  during  simulator  training. 

The  influence  of  platform  motion  is  not 
necessarily  beneficial,  however.  Excessive 
or  inappropriate  motion,  e.g.,  high  levels  of 
simulated  turbulence,  could  make  learning 
less  rapid  if  it  were  a factor  in  making  the 
simulator  more  difficult  to  control.  Like- 
wise, motion  that  is  out  of  synchronization 
with  visual  or  other  cues  could  interfere 
with  simulator  control  if  it  made  trainees 
ill  or  presented  misinformation  to  them.  For 
example,  it  has  been  reported  that  the  simu- 
lator used  in  the  Air  Force  ASPT  study  cited 
above  has  time  lags  in  the  motion  system  that 
make  the  performance  of  some  maneuvers  diffi- 
cult (Hutton,  Burke,  Englehart,  Wilson, 
Romaqlia,  A Schneider,  1976). 


MANWVER  MOTION  VS,  DISTURBANCE  MOTION 

In  discussing  the  influence  of  motion 
upon  pilot  performance  in  simulators,  Gundry 
(1976a,  1976b)  distinguishes  between  two 
kinds  of  motion  cues  and  uggests  that  they 
might  affect  performance  differentially. 
Maneuver  motion  is  that  motion  that  arises 
within  the  control  loop  and  results  from 
pilot-initiated  changes  in  the  motion  of  the 
aircraft  in  order  to  change  its  heading, 
altitude,  or  attitude.  Disturbance  motion, 
on  the  other  hand,  arises  outside  the  control 
loop  and  results  from  turbulence  or  from 
failure  of  a component  of  the  airframe, 
equipment  or  engines  that  causes  an  unexpec- 
ted (to  the  pilot)  motion  of  the  aircraft. 
Matheny  (1976)  made  a similar  distinction  in 
a study  in  which  he  identified  aircraft  mo- 
tion as  resulting  from  either  external  forc- 
ing functions  or  input  into  the  aircraft 
control s . 

The  reason  that  platform  motion  can  re- 
sult in  quicker,  more  accurate  simulator 
control  probably  is  that  the  disturbance 
component  of  that  motion  resulting  from  simu- 
lated turbulence  or  equipment  failure  can 
provide  more  rapid  and  relevant  alerting  cues 
about  forces  acting  upon  the  aircraft  than 
could  be  obtained  from  other  cues  sources. 
Maneuver  motion  does  not  fulfill  an  alerting 
function,  because  it  results  from  pilot- 
initiated  control  movements.  Research  involv- 
ing maneuver  motion,  Gundry  states,  indicates 
that  this  component  of  platfonii  motion  has 
little  effect  upon  the  control  of  an  aircraft 
whose  flight  dynamics  are  stable.  For  un- 
stable vehicles,  however,  the  presence  of 
maneuver  motion  will  allow  the  pilot  to  main- 
tain control  even  in  flight  regions  where 
control  by  visual  cues  alone  would  be  impos- 
sible. Thus,  disturbance  motion  permits  more 
rapid  and  accurate  aircraft  control  under  all 
flight  conditons  in  which  such  motion  is 
appropriate.  Maneuver  motion,  however,  im- 
proves aircraft  control  only  when  the  air- 
craft is  unstable. 

In  both  the  Jacobs  and  Roscoe  and  t(ie 
Air  lorce  ASPT  studies  cited  above,  emphasis 
was  upon  simulation  of  maneuver  rather  than 
disturbance  motion.  Since  maneuver  motion  is 
pilot  induced  and  the  aircraft  involved  in 
these  studies  were  quite  stable,  the  most 
likely  role  of  motion  was  to  provide  feedback 
to  the  pilot.  If  sufficient  feedback  were 
available  from  other  sources  such  as  the  air- 
craft instruments  or  an  extra-cockpi t visual 
display,  as  likely  was  the  case,  the  maneuver 
motion  provided  in  these  two  studies  could 
not  be  expected  to  have  a large  effect  upon 
simulator  training  effectiveness,  and  pi'Obab- 
ly  would  be  ignored  altogether  by  the  train- 
ees. Had  these  two  studies  examined  the 
influence  of  disturbance  motion  resulting 
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from  factors  outside  the  control  loop,  e.g., 
malfunctions,  the  results  might  have  been 
di fferent. 

Tile  evidence  that  disturbance  motion  may 
have  a large  effect  upon  pilot  performance 
in  the  simulator  and  upon  his  subsequent  per- 
formance in  the  aircraft  should  not  be  over- 
looked by  personnel  making  decisions  concern- 
ing the  importance  of  platform  motion  in 
aircraft  simulator  training.  The  fact  that 
the  influence  of  such  motion  was  not  apparent 
in  two  recent  transfer  of  training  studies  is 
probably  attributable  to  the  absence  of  a 
significant  disturbance  component  to  the 
motion  involved  in  those  studies.  The  man- 
euver motion  that  was  present  appears  not  to 
have  been  a significant  factor  in  transfer  of 
training  for  the  undergraduate  level  trainee 
in  the  relatively  stable  aircraft  involved  in 
these  studies . 


PILOT  PERCEPTIONS  OF  MANEUVER  AND  DISTURBANCE 
CUES  " 

The  author  recently  had  occasion  to 
examine  four  Air  Force  simulator  training 
programs  in  which  simulators  with  motion  were 
employed.  The  simulators  were  the  C-5A,  the 
FB-llIB,  the  F-4D  and  E,  and  the  A-7E.  Al- 
though the  contribution  of  motion  to  the 
effectiveness  of  the  combat  crew  training 
and  continuation  training  activities  in  which 
these  simulators  are  used  has  not  been  in- 
vestigated empirically,  the  perceived  value 
of  the  platform  motion  cues  they  provide 
was  discussed  with  Air  Force  pilots  and  in- 
structors who  participate  in  that  training. 
Many  of  these  personnel  held  strong  opinions 
concerning  the  probable  value  of  motion. 

While  those  opinions  were  predominantly 
favorable,  there  were  a few  unfavorable  ones 
as  well.  In  all  cases,  whether  favorable  or 
unfavorable,  the  basis  for  the  opinions  ex- 
pressed was  explored  by  the  investigator. 

Favorable  opinions  were  difficult  to 
relate  to  specific  aspects  of  motion  simula- 
tion and  in  many  cases  were  considered  to  be 
endorsements  of  the  general  idea  that  simu- 
lator motion  is  important  because  the  air- 
craft moves.  Those  who  were  the  most 
enthusiastic  in  their  opinions  favoring 
motion  cited  motion  characteristics  of  the 
disturbance  type  as  the  primary  basis  for 
their  positive  views,  i.e.,  motions  associa- 
ted with  equipment  failure,  weapons  release, 
buffet  and  turbulence.  Very  few  pilots  ex- 
pressed strong  positive  feelings  toward 
maneuver  motion  --  it  contributed  to  realism 
but  was  not  cited  as  specifically  related  to 
particular  training  goals. 

The  relatively  few  negative  opinions 
expressed  concerning  motion  were  all  strongly 
held,  and  they  involved  both  maneuver  and 


disturbance  motion.  In  one  simulator  in 
which  maneuver  motion  cues  lagged  noticeably 
behind  instrument  displays  and  tended  to  be 
jerky  rather  than  smooth,  the  motion  was 
viewed  as  annoying,  and  pilots  using  that 
particular  device  preferred  to  train  with  the 
motion  system  inoperative.  Apparently, 
maneuver  motion  can  have  little  positive 
value  in  most  simulator  training  programs, 
but  it  can  have  a negative  influence,  at 
least  upon  pilot  attitudes,  if  it  is  not 
representative  of  comparable  motion  in  the 
aircraft,  e.g.,  if  it  lags  noticeably  the 
pilot's  control  input  or  the  cues  provided 
by  instruments  or  visual  displays. 

Most  of  the  negative  comments  received 
during  the  interviews  could  be  related  to 
disturbance  motion  --  or,  more  precisely,  to 
the  absence  of  disturbance  motion  cues  that 
the  pilots  knew  to  be  characteristic  of  the 
aircraft  simulated.  Two  examples  of  this 
situation  were  noted,  one  involving  the  A-7D 
simulator  and  the  other  involving  the  C-5A 
simulator. 

A critical  condition  involving  the  A-7D 
aircraft  is  that  labeled  "Departure."  It  is 
a high  angle  of  attack  condition  in  which  the 
aircraft  yaws  abruptly  and  enters  an  uncon- 
trollable spin.  The  yaw  in  this  case  is  a 
disturbance  cue  that  alerts  the  pilot  to  the 
condition's  onset.  Training  in  recovery 
from  the  departure  is  considered  of  critical 
importance,  but  such  training  in  the  single- 
place aircraft  is  not  included  in  A-7D 
training  for  reasons  of  flight  safety.  At- 
tempts to  provide  the  desired  training  in 
the  A-7D  simulator  have  been  unsuccessful, 
reportedly  because  the  yaw  motion  cues  can- 
not be  simulated  in  that  device  (it  lacks 
the  yaw  motion  axis  ) . 

The  A-7D  manufacturer  has  a research 
simulator,  called  LAMBS  (for  Large  Amplitude 
Motion  Base  Simulator),  in  which  the  depar- 
ture can  be  simulated  with  the  yaw  motion 
component.  All  Air  Force  A-7D  pilots  have 
undergone  departure  recovery  training  in 
LAMBS.  Pilots  who  have  previously  experi- 
enced a departure  in  the  aircraft  have  re- 
ported that  its  simulation  in  LAMBS  is 
"realistic."  Pilots  who  received  training 
in  IAMBS  and  subsequently  experienced  a 
departure  in  the  aircraft  credit  the  motion 
simulator  training  for  the  ease  with  which 
they  were  able  to  reestablish  aircraft  con- 
trol, although  such  reports  are  purely  sub- 
jective. In  any  event,  the  yaw  disturbance 
cue  provided  by  LAMBS  is  well  received  by 
Air  Force  A-7  pilots,  whereas  the  absence 
of  that  cue  in  the  Air  Force  simulator  ren- 
ders departure  recovery  training  in  it  un- 
acceptable. 

One  of  the  A-7D  pilots  interviewed  had 
recently  flown  the  Navy's  A-7E  simulator 
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that  has  a six-axis  motion  system.  That  pilot 
expressed  a highly  favorable  opinion  concern- 
ing A-7D  simulator  training.  While  there  are 
a number  of  differences  in  these  two  simula- 
tors and  the  manner  in  which  they  are  used, 
the  extent  of  motion  simulation  was  singled 
out  as  an  important  difference  between  the 
two  devices  which,  in  the  opinion  of  that 
particular  pilot,  influences  training. 

The  C-5A  simulator  motion  platform,  like 
that  of  the  A-7D,  lacks  the  yaw  axis,  so  the 
yaw  disturbance  motion  associated  with  loss 
of  an  engine  cannot  be  simulated.  Pilots 
associated  with  C-&A  training  at  Altus  AFB 
cited  this  deficiency  in  the  simulator  as  a 
negative  factor  in  determining  the  effective- 
ness of  simulator  training  for  engine  losses 
at  low  altitude.  It  was  not  cited  as  a fac- 
tor in  other  training  operations,  including 
operations  that  involve  yaw  maneuver  motion, 
however  Thus,  where  yaw  could  be  considered 
a disturbance  motion,  it  was  perceived  by 
these  pilots  to  be  needed  for  training;  where 
it  could  be  considered  a maneuver  motion,  it 
was  not  perceived  as  important. 

The  C-5  simulator  described  above  has  a 
visual  display,  and  the  yaw  of  the  aircraft 
associated  with  engine  loss  is  reflected  in 
the  visual  scene.  The  pilots  indicated  that 
the  visual  yaw  cue  alone  was  insufficient,  in 
their  opinion,  when  engine  loss  occurred 
during  landing  and  takeoff  maneuvers.  They 
felt  that  pilots  in  the  simulator  responding 
to  visual  cues  were  much  slower  in  initiating 
corrective  action  than  they  were  in  the  air- 
craft where  motion  provides  an  early  and  more 
pronounced  alert  that  a disturbance  has 
occurred. 


DISCUSSION 

The  influence  of  platform  motion  upon 
transfer  of  simulator  training  has  not  been 
clearly  established  by  the  data  available  at 
the  present  time.  It  has  been  demonstrated 
that  motion  can  affect  pilot  performance  in 
the  simulator  in  ways  that  may  make  his  per- 
formance in  the  simulator  more  like  his  per- 
formance in  the  aircraft,  but  it  has  not  been 
siiown  that  simulator  motion  enhances  his  sub- 
sequent perfonnance  in  the  aircraft.  The  two 
studies  that  have  addressed  the  question  of 
transfer  directly  did  not  support  a conclu- 
sion that  motion  is  needed.  Likewise,  there 
is  no  consensus  among  pilots  as  to  the  need 
for  motion  in  simulator  training. 

The  distinction  between  maneuver  and 
disturbance  motion  is  useful  in  attempting  to 
understand  both  the  prior  research  on  motion 
and  the  reactions  of  pilots  to  the  motion 
component  of  aircraft  simulators.  In  the 
transfer  of  training  studies  in  whicti  motion 
did  not  appear  to  influence  subsequent  pilot 


performance,  the  motion  involved  was  predomi- 
nantly, if  not  exclusively,  of  the  maneuver 
variety.  On  the  other  hand,  disturbance 
nwtion  was  the  predominant  type  of  motion  in 
studies  in  which  changes  in  pilot  performance 
were  related  to  motion  simulation.  Thus,  the 
results  of  both  sets  of  studies  can  be  ac- 
cepted and  attributed  to  the  nature  of  the 
nxjtion  simulation  involved  in  each.  Distur- 
bance motion  is  important,  at  least  in  train- 
ing situations  where  disturbance  cues  can  be 
related  to  specific  training  objectives  and 
when  the  aircraft  simulateo  is  unstable  or  is 
particularly  responsive  to  control  input. 
Maneuver  motion  may  be  important  also  under 
some  circumstances,  but  the  evidence  avail- 
able at  this  time  has  not  shown  that  it 
contributes  to  transfer  of  training  in  easy- 
to-fly  aircraft  with  undergraduate  level 
trainees . 

More  attention  has  been  paid  in  the 
design  of  training  simulators  to  maneuver 
motion  than  to  disturbance  motion.  Emphasis 
has  been  upon  providing  in  a simulator  the 
motion  cues  associated  with  we  11 -coordinated 
pilot  control  inputs,  scaled  down  to  the 
limits  of  travel  and  accelerations  of  the 
motion  platform.  Since  most  training  and 
operational  aircraft  are  relatively  stable 
and  easy  to  control  in  flight,  this  kind  of 
motion  simulation  may  be  of  very  little  po- 
tential value  in  training.  It  might  be  more 
beneficial  from  the  training  standpoint  to 
provide  the  motion  cues  associated  with  dis- 
turbances to  the  aircraft  not  originated  by 
the  pilot,  and  then  only  at  their  initial 
onset  values,  so  that  the  pilot  can  learn  to 
respond  specifically  to  such  cues  rather 
than  learning  to  respond  to  visual  or  other 
cues  that  occur  later  in  time. 

Because  the  distinction  between  maneuver 
and  disturbance  motion  has  only  recently  been 
articulated,  there  has  been  little  opportu- 
nity to  examine  systematically  the  influence 
of  each  upon  simulator  training  effective- 
ness. Most  prior  training  research  on  motion 
appears  to  have  dealt  primarily  with  maneu- 
ver motion,  and  maneuver  motion  appears  rea- 
sonably well  represented  in  the  newer  simu- 
lators, although  time  lags  between  pilot 
manipulation  of  aircraft  controls  and  motion 
system  responses  have  been  a major  problem 
in  some  of  them.  Disturbance  motion  has 
been  less  thoroughly  investigated,  and  it  is 
poorly  or  incompletely  represented  in  many 
ru'wer  simulators.  In  *act,  data  on  distur- 
bance motion  cues  generally  have  not  been 
developed  and  consequently  are  not  available 
to  motion  system  designers. 

Additional  research  upon  the  role  of 
disturbance  motion  in  training  is  clearly 
needed.  Emphasis  in  such  research  should  be 
three-fold;  (1)  analysis  of  reciui rements 
for  disturbance  motion  cues  associated  with 


96 


specific  simulator  training  objectives; 

(2)  development  of  models  for  the  representa- 
tion of  critical  components  of  such  motion  in 
simulators;  and  (3)  determination  of  the 
effects  on  transfer  of  training  of  the  pres- 
ence and  absence  of  such  motion. 

Because  of  the  continuing  concern  over 
the  costs  associated  with  motion  simulation, 
future  research  on  motion  simulation  should 
also  examine  the  use  of  platform  motion  sys- 
tems with  limited  axes  of  motion,  g-suits  and 
seats,  and  "seat  shakers"  to  determine  whe- 
ther the  disturbance  cues  found  to  be  impor- 
tant in  training  can  be  represented  adequate- 
ly in  such  relatively  low  cost  motion  devices. 
In  any  event,  future  motion  system  designs 
should  be  responsive  to  requirements  to  pro- 
vide specific  movements  which  cue  specific 
pilot  responses  rather  than  to  provide  mo- 
tions which  simply  correspond  to  motions  of 
the  simulated  aircraft. 

The  real  issue  in  simulator  motion  sys- 
tem design  is  the  relating  of  motion  cues  to 
required  pilot  responses.  What  are  the  mo- 
tion cues  to  which  a pilot  responds  during 
flight?  What  discriminations  must  he  make 
among  them?  How  do  they  affect  his  perfor- 
mance? How  can  they  be  provided  economi- 
cal ly? 
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ARMOR  TRAINING  DEVICE  REQUIREMENTS 

CAPTAIN  STEVEN  0.  VANDAL 

US  Army  Project  Officer,  Training  Devices 
US  Amy  Armor  School,  Fort  Knox,  Kentucky 


The  training  environment  in  Armor  Units,  as 
in  other  units,  appears  to  be  fairly  hostile 
in  the  eyes  of  the  unit  comnander.  To  varying 
extents,  they  are  faced  with  shortages  of  time, 
money,  space,  equipment,  operating  resources 
of  fuel  and  ammunition,  and  trained  leaders, 
Personnel  turnover  complicates  the  already 
serious  situation.  These  problems  make  it 
difficult  for  Armor  leaders  to  live  up  to  the 
now  familiar,  but  critical,  imperatives  in 
these  slogans; 

Win  the  first  battle  of  the  next  war! 

Fight  outnumbered  and  win! 

Fire  fast,  first! 

Progress  is  being  made  in  training,  New 
Army  Training  and  Evaluation  Programs, 

Soldiers  Manuals,  and  Skill  Qualification 
Tests,  to  name  a few  things,  have  been  pro- 
duced and  fielded.  These  are  based  on  criti- 
cal missions  and  tasks  with  corresponding 
conditions  and  standards  that  units  must  meet 
year  round.  Yet  the  realities  of  range  avail- 
ability, time,  ammunition,  and  dollar  con- 
straints still  force  Armor  units  into  cyclic 
participation  in  and  evaluation  of  main  gun 
firings  and  combined  arms  tactical  exercises. 

The  result  approximates  a sine  curve  of 
proficiency  pears  and  valleys  showing  the 
fluctuation  in  meeting  the  minimum  profi- 
ciency standards  expressed  in  current  soldiers 
manuals  and  Army  training  and  evaluation 
programs.  We  feel  the  sine  curve  of  pro- 
ficiency must  be  leveled  and  that  the  minimum 
pro^^iciency  standard  must  be  raised  as  well 
if  we  are  indeed  to  win  the  first  battle  of 
the  next  war  outnumbered.  We  hope  to  achieve 
this  higher  and  more  constant  level  of  pro- 
ficiency through  the  increased  use  of  training 
devices  and  training  simulation  systems  in 
addition  to  continuing  to  upgrade  the  balance 
of  the  training  package. 

Today  there  are  very  few  training  devices 
available.  Most  of  them  are  oriented  on 
individual  tasks  and  are  primarily  used  at 
our  major  Institutions.  Those  devices  which 
are  in  the  field  are  either  very  primitive  in 
terms  of  their  training  capability,  or  are 
just  recently  being  received  by  Armor  units. 

To  resolve  the  problem,  the  Armor  School  has 
developed  a three  phase  strategy  and  training 
device  requirements  plan  to  upgrade  the  pro- 
ficiency and  to  reduce  the  resources  a unit 


currently  expends  during  tank  gunnery  training 
and  individual  crew  qualification. 

The  first  phase  of  our  strategy,  now 
training  and  through  1979,  is  centered  around 
the  significant  revisions  of  our  new  tank 
gunnery  manual,  FM  17-12,  Our  immediate 
emphasis  is  on  substituting  main  gun  firing 
with  subcaliber  devices  on  reduced  scale 
ranges.  (A  subcaliber  device  is  one  which 
allows  a smaller  projectile  to  fire  instead 
of  a main  gun  round.)  This  allows  more  firing 
to  be  done  for  less  money  and  in  smaller 
training  areas.  One  major  result  of  these 
devices  and  the  new  FM  17-12  is  a AOT  reduc- 
tion in  main  tank  gun  rounds  required  to  be 
fired  during  annual  tank  gunnery  qualifi- 
cation. Another  is  the  ability  to  provide 
more  training  right  where  the  soldiers  are 
located  instead  of  moving  to  a larger  train- 
ing area.  This  is  an  important  step  if  we 
expect  to  be  able  to  keep  our  soldiers  and 
units  proficient  on  a year-round  basis.  One 
of  the  more  significant  devices  to  be  included 
in  our  requirements  plan  and  to  be  developed 
in  this  first  phase  is  a TV  camera  system  for 
gunnery  training  called  the  Tank  Appended 
Crew  Evaluation  Device.  It  will  present  to 
an  instructor  a view  of  the  gunner's  sight 
picture  so  that  scoring  will  not  be  as  sub- 
jective as  in  the  past  and  so  that  correction 
of  sighting  errors  can  be  made.  The  sight 
picture  as  well  as  a frontal  view  of  the  tar- 
get from  an  overview  camera,  timing  informa- 
tion, and  all  crew  member  verbal  exchanges 
are  recorded.  This  allows  objective  after- 
action review  and  critique  with  the  gunner 
and  tank  commander  reviewing  their  own  results. 
This  device  should  significantly  improve  on- 
the-tank  training,  whether  with  dry  fire, 
sujjcaliber  fire  or  service  ammunition. 

Other  training  devices  are  also  planned 
for  introduction  near  the  end  of  this  phase 
and  requirements  have  been  developed  for  them. 
One  is  a unit  level  gunnery  or  conduct  of 
fire  trainer  for  each  of  the  current  tanks. 

This  will  allow  gunner  and  tank  connander 
skills  to  be  sharpened  and  maintained  off 
the  tank  and  in  the  garrison  area  of  the  tank 
company.  It  will  provide  training  in  pre- 
cision gunnery  techinques  with  all  the  tank's 
fire  control  equipment  against  varied  and 
multiple  targets  in  many  visibility  condi- 
tions. Simulated  tracers  for  both  the 
machineguns  and  main  gun  will  be  provided  as 
well  as  a burst-on-target  projection  for 
main  gun  hits.  Hits  and  misses  will  be 
recorded  for  evaluation  purposes. 
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Addi  tion.i  H y . trainers  for  the  loader  of 
each  tank  are  heinq  developed.  The  loader 
has  a physirally  difficult  and  danqerous  job 
when  the  tank  is  firing  on  the  move  with 
■•tcibilized  gunnery.  Not  only  is  the  tank 
itself  moving,  hut  the  breech  of  the  gun  is 
in  constant  motion  whiie  it  maintains  the 
line  of  sight.  This,  coupled  with  recoil, 
a floor  littered  with  shell  casings,  and  the 
sheer  weight  of  the  projectiles  makes  it 
absolutely  necessary  for  the  loader  to  be 
adequately  trained  if  the  tank  is  to  be  used 
to  its  full  potential  of  firing  on  the  move. 
Currently,  the  only  training  in  loading  the 
main  gun  which  the  loader  gets  is  in  con- 
junction with  actual  fire.  The  loader  trainer 
is  envisioned  for  use  at  the  battalion  level 
and  in  the  school  environment. 


Phase  II  of  the  Armor  Training  Device 
Strategy  covers  the  period  from  1980  through 
1984.  It  will  begin  with  a second  edition 
of  our  gunnery  manual.  In  addition,  our 
soldiers  manuals,  skill  qualification  tests, 
and  Army  training  and  evaluation  programs 
will  be  changed  to  reflect  the  increased 
training  capabilities  and  training  standards 
provided  through  the  use  of  simulation 
devices.  In  this  phase,  a greater  percentage 
of  main  guri  ammunition  will  be  allocated  to 
platoon  and  company  collective  gunnery.  We 
hope  to  be  able  to  provide  almost  all  indivi- 
dual and  single  crew  gunnery  training  by 
simulation. 

At  the  beginning  ot  this  phase,  we  expect 
to  receive  at  Fort  Knox  an  especially  signi- 
ficant item  of  simulation  equipment;  the 
Armor  Full  Crew  Interaction  Simulator.  It 
will  be  a one-of-a-kind  test  bed  for  the 
general-purpose  of  evaluating  simulation 
technology  and  its  potential  application  in 
training  tank  crews  and  also  for  the  specific 
purpose  of  evaluating  the  concept  of  the  Full 
Crew  Interaction  Simulator  itself  - full  crew 
training  in  a totally  simulated  environment. 
This  test  bed  will  be  developed  from  present 
technology  available  in  flight  simulators  and 
foreign  driver  trainers,  and  will  consist  of 
modules  for  each  crew  position. 

A significant  feature  of  the  Armor  Full 
Crew  Interaction  Simulator  will  be  the  ability 
to  turn  on  and  off  various  cues  and  functions 
of  the  simulation  system.  This  will  assist 
in  evaluating  which  cues,  in  terms  of  audio, 
visual,  and  motion,  and  which  functions,  in 
terms  of  gunnery  controls  and  driver  controls, 
are  necessary  to  train  crew  members  in  either 
the  Individual  or  full  crew  training  environ- 
ments. All  equipment  at  each  crew  position 
will  have  the  same  cues,  functions,  and  physi- 
cal appearance  as  the  actual  tank.  The 


visual  presentation  of  the  simulated  battle- 
field will  be  as  realistic  as  possible.  It 
will  have  multiple  target  arrays,  hostile 
targets  which  can  fire  back,  and  battlefield 
obscuration,  which  includes  smoke  screens  and 
the  effects  of  artillery.  For  control  and 
evaluation  purposes,  the  instructor  will  have 
the  capability  of  selecting  the  initial 
engagement  parameters  and  target  scenes,  and 
of  injecting  malfunctions  such  as  misfires 
and  fire  control  system  failures.  This 
feature  is  designed  to  test  the  utility  of 
the  various  functions. 

The  simulator  will  further  be  used  for 
establishing  crew  selection  criteria,  for 
evaluating  engagement  and  evasion  techniques, 
and  to  validate  training  standards  under 
variable  conditions.  The  variable  conditions 
can  be  electronic  warfare,  nuclear,  biological 
or  chemical  environments,  or  difficult  terrain, 
weather  and  visibility  conditions.  If  testing 
proves  the  system  to  be  effective,  firm 
requirements  for  mobile  full  crew  simulators 
will  be  submitted.  In  effect,  the  test  bed 
has  the  potential  to  serve  as  the  first 
operational/developmental  test  for  the  pro- 
posed XMl  and  M60A3  full  crew  interaction 
simulators . 

The  test  bed  just  described  is  only  one  of 
many  developments  to  be  made  available  in 
this  phase.  Another  significant  system  will 
be  the  Tank  Weapons  Gunnery  Simulation  System 
(TWGSS).  Basically,  the  TWGSS  will  provide 
realistic  simulated  precision  gunnery  training 
for  the  tank  commander  and  gunner  on  the  tank, 
exercising  the  driver  also  and,  to  a lesser 
extent,  the  loader.  Precision  gunnery  is 
emphasized  to  avoid  confusion  with  the  simpler 
gunnery  aspects  of  the  Multiple  Integrated 
Laser  Engagement  System  (MILES)  which  is  pri- 
marily a tactical  training  system  and  uses 
strictly  1 ine-of-sight  gunnery.  Elevation 
and  lead  angle,  for  example,  are  not  accounted 
for  In  the  MILES  system,  TWGSS  will  allow 
individual  crew  gunnery  tables  to  be  fired  by 
simulation  while  on  the  actual  vehicle  thus 
permitting  the  shifting  of  live  ainnun i t- i on 
usage  to  platoon  and  company  firing.  This 
will  permit  platoon  and  company  battleruns  to 
be  simulated  in  practice  prior  to  live  firing. 

The  TWGSS  integrates  the  entiri  tank 
weapons  system  with  simulation  to  provide  • i 
training  ir,  the  acquisition  and  enqagei"en*  • , 
and  adjustment  of  fire  upon,  stati.'n.ir,  r ■ 
moving  targets  from  either  a staii  >'n-, 
moving  firing  tank.  For  the  n.itn  i.e, 
system  will  superimpose  a s ifx,!  ■ • , ■ 

real-time  over  the  cal'  ul.i'>'!  ' , i • 
the  gunner's  sight,  as  > ■ . 

burn  and,  through  inter*,  . » , 

device,  flash,  bang,  let 
display  is  presen*.'  : • • • . ■ . 
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Miihinegun  simulation  will  also  be  provided  in 
conjunction  with  separately  developed  blank 
tiring  adapters.  Machinegun  tracers  will 
appear  in  the  sights  to  allow  bursts  to  be 
"walked  in"  to  the  target,  for  gunnery  pro- 
ficiency evaluation  purposes,  the  system  will 
have  record/playback  and  real-time  audio  and 
video  media  plus  hits  and  numbers-of -rounds 
expended  counters.  All  verbal  exchanges  as 
well  as  the  gunner's  sight  picture  will  be 
recorded. 

TWGSS  will  operate  with  both  daylight  and 
night  sights  and  the  thermal  sight.  It  will 
also  be  interoperable  with  new  target  systems 
in  development  and  an  eye-safe  training  device 
tor  the  laser  range  finder.  Based  on  the 
success  of  this  first  stage  as  described,  it 
is  planned  that  the  system  be  expanded  to 
provide  for  up  to  battalion  level  force-on- 
force  exercises  with  precision  gunnery  engage- 
ments . 

In  conjunction  with  the  unit  level  conduct 
of  fire  trainer  to  be  issued  in  Phase  I,  the 
Tank  Weapons  Gunnery  Simulation  System  will 
go  far  toward  leveling  the  peaks  and  valleys 
of  gunnery  proficiency  by  providing  a system 
for  realistic,  year-round  precision  gunnery 
training.  TWGSS  will  be  able  to  develop, 
maintain,  and  objectively  evaluate  individual 
and  crew  proficiency  in  all  tank  gunnery 
Skills  without  the  use  of  live  ammunition 
or  dedicated  range  facilities.  It  will,  as 
a result,  provide  a highly  increased  training 
capability  using  the  same  or  less  resources 
than  at  present.  The  projected  operational 
date  is  mid-1982. 

Related  to  this  system,  as  was  mentioned, 
is  the  Eye-Safe  Laser  Range  Finder  Training 
Device.  This  device,  planned  for  late  1981, 
will  provide  for  the  safe  use  of  the  laser 
range  finder  during  force-on-force  engagements, 
but  just  as  important  will  be  its  value  in 
training  laser  range  finder  operators.  The 
characteristics  of  current  laser  range  finders 
often  cause  multiple  returns  to  be  received, 
forcing  the  operator  to  either  make  a choice 
between  them  or  re-range.  Stringent  safety 
reguirements  now  greatly  restrict  the  practice 
necessary  to  reduce  the  occurrence  of  multiple 
returns  and  to  make  correct  choices  from  among 
them  when  they  do  occur.  The  training  device 
will  either  be  a complete  simulation  of  or  an 
attachment  to  the  actual  laser  range  finder. 


Training  in  tactics  will  also  receive  a big 
boost  during  this  phase  with  the  introduction 
of  the  Multiple  Integrated  Laser  Engagement 
System  (MILES).  When  the  forerunner  of  MILES, 
REALTRAIN,  was  Implemented  in  Europe,  tests 
showed  large  increases  in  capability  of  an 
armored  platoon  after  the  third  week  of 


training  when  compared  to  the  results  of  the 
platoon  at  the  end  of  their  first  week.  The 
dictum  "fire  fast,  first"  is  going  to  be 
accomplished  if  these  results  are  any  in- 
dication, and  we  believe  they  are:  a 55% 
increase  in  first  detections  of  the  "enemy" 
and  a 153%  increase  in  first  engagements  of 
the  enemy.  This  is  reflected  also  in  a 26% 
Increase  in  tank  survivability  and  a 49% 
Increase  in  tank  killing  prowess.  Although 
these  are  only  initial  results,  they  point 
to  what  we  can  expect  MILES  to  provide. 
REALTRAIN  can  only  be  used  effectively  at 
the  platoon  level,  because  of  the  extensive 
controller  network  required.  With  MILES,  an 
entire  battalion  can  be  trained.  Scoring 
objectivity  will  rise  with  the  use  of  auto- 
matic equipment  triggered  by  simulated  fire 
and,  at  the  same  time,  manpower  resources 
will  be  conserved  as  controller  density  and 
training  requirements  will  be  lowered. 

The  new  XMl  tank  will  be  fielded  near  the 
beginning  of  this  second  phase  of  our  plan 
along  with  a set  of  training  devices  for 
institutional  and  unit  use.  A conduct  of 
fire  gunnery  trainer  and  a loader  trainer, 
much  as  described  for  the  other  tanks,  will 
be  fielded  for  unit  use.  The  large  training 
centers  will  have  two  other  trainers  designed 
to  Increase  the  student  to  instructor  ratio. 

A ten-station  conduct  of  fire  gunnery  trainer 
and  a five-station  driver  trainer  are  in 
development,  each  of  which  will  only  require 
one  instructor.  The  gunnery  trainer  will  be 
slightly  more  limited  than  the  unit  level 
model  in  that  it  will  only  train  the  gunner 
and  not  the  tank  commander.  The  driver 
trainer  will  be  basically  a procedures 
trainer  with  a series  of  preprogramned  visual 
presentations  synchronized  with  student 
responses. 

In  addition  to  the  gunnery  and  tactics 
simulators,  we  also  have  an  urgent  need  to 
increase  the  effectiveness  of  our  main  gun 
firing  by  providing  an  improved  target 
system,  the  Remoted  Target  System  (RETS), 
which  should  be  available  in  1982.  The 
Remoted  Target  System  will  have  remotely 
controlled,  automatically  scored,  portable 
pop-up  and  pop-down  stationary  targets  and 
free  roving,  remotely  controlled  moving 
targets.  This  system  should  significantly 
increase  the  effectiveness  of  main  gun  firing 
by  providing  realistic  targets,  reliable 
machinequns,  and  automatic  scoring. 

The  devices  in  this  phase  will  provide  the 
ability  to  perform  individual  and  most  crew 
training  with  a very  high-level  of  realism. 
Perhaps  a more  important  factor  will  be  the 
higher  level  of  availability  to  the  trainer. 
By  the  end  of  Phase  II,  our  initial  sine 
curve  should  be  flattening  out  and  the  actual 
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proficiency  line  should  be  getting  closer  to 
the  proficiency  of  the  future. 

Phase  III  will  begin  with  a third  edition 
of  the  tank  gunnery  manual.  It  will  be  up- 
dated to  include  the  new  gunnery  training 
strategy  and  gunnery  exercises  made  possible 
through  increased  use  of  simulators  and 
devices.  Other  training  literature  and  tests 
will  also  have  to  be  updated  to  reflect  the 
increased  training  capabilities  and  new 
training  standards.  One  of  our  major  goals 
is  to  shift  all  main  gun  firings  to  the 
platoon  and  company  levels,  where  we  feel 
we  will  gain  the  greatest  training  payoff. 
This  goal  should  be  realized  by  the  end  of 
this  phase.  We  will  still  require  main  gun 
firing  of  the  gunnery  tables  at  Fort  Knox 
to  train  entry  level  Armor  crewmen. 

Phase  in,  1985  to  1990,  should  realize 
the  complete  integration  of  all  Phase  II 
training  devices  into  the  Armor  training 
program.  In  addition,  two  new  training 
capabilities  should  be  added.  The  Tank 
Weapons  Gunnery  Simulation  System  will  be 
expanded  to  include  a force-on- force  capa- 
bility. It  will  be  the  follow-on  to  MILES 
for  armor  and  will  allow  the  complete 
integration  of  precision  gunnery  with 
tactical  training.  It  will  require  the  tank 
crew  to  perform  all  its  duties  correctly  in 
order  to  achieve  a kill  on  the  simulated 
battlefield  and  not  just  point  the  gun  and 
fire. 

Also,  based  on  the  full  crew  simulator 
test  bed  results,  we  plan  to  issue  a mobile 
full  crew  interaction  simulator  for  both  the 
XMl  and  M60A3  tanks  to  be  used  at  the 
battalion  level.  The  mobile  Full  Crew  Inter- 
action Simulator  (FCIS)  should  provide  the 
crew  the  most  realistic  training  available, 
short  of  actual  combat,  and  provide  it  on  a 
year-around  basis.  The  following  items  show 
a rough  analysis  of  what  a full  crew  inter- 
action simulator  might  mean  to  a battalion 
in  terms  of  engagements  available  and 
potential  cost  avoidance. 

0 Assumptions 

40  hr  training  week,  48  weeks/year 
54  tanks  per  battalion 
1 engagement  every  3 minutes 
15  year  life  cycle  for  the  simulator 
#3  Mil  initial  procurement  cost 
$200K  per  year  operating  cost 


0 Crew  training  hours  available  on  FCIS: 
35:56  hr/crew/yr 


0 Available  engagements  per  year  on  FCIS: 

711  engage/crew/yr 

0 Available  simulated  mileage  (10  MPH)  per 
year:  355.6  mi les/crew/yr 

0 Current  cost  per  crew  to  fire  gunnery 
tables:  $36,928 

0 Current  cost  per  mile  to  operate  M60A1 
tank:  $15.15 

0 Mileage  driven  during  annual  gunnery 
(Europe) : 500  mi les 

0 Total  cost  per  battalion  for  one  year: 

$2.43  mil 

0 Total  cost  per  battalion  for  15  years: 
$36.45  mil 

0 Total  cost  with  6%  inflation:  $50.9  mil 

0 15  year  life-cycle  cost  of  an  FCIS;  $6.0 

mi  1 

0 Available  for  platoon,  company  and  bat- 
talion collective  live  fire  gunnery 
training;  $44.9  mi  1 

These  Phase  III  devices  would  actually  permit 
full  simulation  of  all  gunnery  training,  no 
matter  what  the  level.  However,  we  are 
firmly  convinced  that  our  troops  must  engage 
in  live  fire  exercises  if  they  are  to  maximize 
the  weapons  system  effectiveness  of  the  tanks. 
We  are  also  convinced  that  this  live  fire 
should  be  accomplished  during  the  collective 
training  of  our  platoons,  companies,  and 
battalions.  The  overall  payoff  will  be 
realized  in  increased  unit  readiness.  While 
we  intend  for  ammunition  saved  through 
simulation  to  be  expended  in  collective 
firing,  the  development  of  these  systems  will 
permit  us  an  alternative  to  live  fire  in  the 
future,  should  resources  become  drastically 
reduced.  The  devices  developed  in  each  phase 
will  be  retained  for  the  next  phase  ensuring 
continued  training  should  any  part  of  our 
development  effort  suffer  setbacks. 

Training  requirements  documents  to  support 
the  devices  described  and  other,  supporting 
devices,  have  been  submitted  to  the  US  Anny 
Training  Support  Center.  Through  them,  we  are 
working  with  the  Army  Project  Manager  for 
Training  Devices  to  implement  our  plan.  Each 
device  is  now  in  some  stage  of  development 
and  funding. 
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PATRIOT  DISPLAY  AND  CONTROL  SIMULATION 

P.  WILLIAMS,  G,  KURTZ,  and  J.  GOMBASH 
US  Army  Human  Engineering  Laboratory 


SUMMARY 

This  paper  presents  a description  of  the 
US  Army  Human  Engineering  Laboratory  (USAHEL) 
simulation  and  operator  performance  testing 
of  the  display  and  control  subsystem  of  the 
PATRIOT  Missile  System. 

INTRODUCTION:  During  the  last  3 years  an 
effort  was  undertaken  by  the  HEL  to  r'evelop 
a Command  and  Control  Simulation  Facility 
for  the  purpose  of  evaluating  a variety  of 
Display  and  Control  (D&C)  concepts  and 
designs  which  are  a vital  part  of  today's 
complex  military  systems.  The  PATRIOT  D&C 
subsystem  is  one  of  those  systems  currently 
being  studied. 

To  begin  with  (Figure  1),  I will  give 
you  an  unclassified  overview  of  the  PATRIOT 
Missile  System  currently  in  development. 

Then  I plan  to  talk  about  the  PATRIOT'S  Dis- 
play and  Control  Subsystem  which  HEL  has 
simulated,  the  operator  performance  testing 
conducted  for  improving  the  D&C  operator- 
machine  interface  design.  Then  I'll  describe 
how  we  are  currently  using  the  PATRIOT 
simulator  and  some  future  tests  that  we 
plan  to  do. 

PATRIOT  System  Overview: 

The  PATRIOT  Missile  System  (Figure  2)  is 
a new-generation  Air  Defense  Weapon  System 
now  in  development.  The  unigue  features  of 
the  system  are  a multifunction  phased  array 
radar,  the  track-via-missi le  guidance  system 
and  automated  operation  with  human  control. 

In  PATRIOT,  a single  multifunction 
radar  performs  all  the  tactical  functions 
that,  in  present  systems,  reguire  up  to  five 
separate  radars;  namely,  airspace  surveil- 
lance and  detection,  target  tracking,  identi- 
fication, missile  tracking  and  guidance  and 
counter  measures. 

The  track-via-missi le  guidance  is  the 
second  major  feature.  It  combines  command 
guidance  with  homing  guidance  and,  at  the 
same  time,  provides  for  future  adaptability 
to  the  changing  threat  by  locating  guidance 
processing  in  the  ground  equipment  in  soft- 
ware. This  permits  later  changes,  if  neces- 
sary, to  respond  to  threat  changes  without 
expensive  hardware  modifications  to  the 
missile.  Automated  operation  is  the  third 
major  feature  which  provides  a basis  for  the 
system's  firepower,  effectiveness  and  reduced 
operating  and  maintenance  costs.  The  central 


computer,  monitored  by  operators,  controls 
the  operations  of  the  complete  PATRIOT 
Firing  Platoon  and  monitors  equipment  status 
and  locates  faults  for  repair  by  replacement. 

Finally,  let's  look  at  (Figure  3)  the 
major  equipment  items  comprising  a PATRIOT 
Firing  Platoon.  The  Firing  Platoon  consists 
of  five  major  items:  the  radar  set,  the 
engagement  control  station  and  the  electric 
power  plant  constitute  the  Fire  Control 
Section,  while  five  launching  stations 
each  including  four  missiles  constitute  the 
Launching  Section.  I should  emphasize  at 
this  time  that  once  the  system  is  emplaced 
and  operating,  only  the  engagement  control 
station  is  manned  during  air  defense  missions 
all  other  items  are  remotely  controlled  and 
unattended. 

Figure  A shows  a view  of  the  engagement 
control  station  which  is  where  human  control 
is  exercised.  Stored  computer  programs,  as 
modified  by  operator  selections  and  instruc- 
tions imputted  on  either  of  the  two  operator 
consoles,  control  the  entire  system  opera- 
tion. 

Figure  5 shows  the  contractor's  display 
and  control  consoles  and  Figure  6 shows  one 
of  the  two  consoles  which  have  been  simulated 
by  the  HEL.  Since  they  are  universal  con- 
soles, either  console  can  be  used  by  an 
operator  to  perform  all  functions  or  the 
functions  can  be  divided  between  the  two 
consoles  in  various  ways;  e.g.,  engagement 
control  on  one  console  and  battalion  inter- 
face and  status  monitoring  on  the  other 
console. 

HEL's  PATRIOT  DSC  Simulation  Overview 

Briefly,  the  HEL  simulation  facility 
equipment  consists  of  a Varian  620/f-100 
minicomputer  with  32K  memory,  a real-time 
clock  and  disc  storage  capability,  plus  an 
IDIIOM  graphic-display  system  with  up  to  four 
cathode  ray  tubes,  function  keyboards,  light 
pens  and  tracking  joysticks.  Peripheral 
equipment  includes  a printer,  teletype  and 
card  reader. 

The  computer  programs  are  written  in 
FORTRAN  IV  and  are  structured  for  making 
easy  modifications  to  the  basic  console 
displays  and  control  functions.  The  soft- 
ware programs  developed  for  this  simulation 
are  divided  into  three  categories  (see 
Figure  7). 
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1.  PATRIOT  System  overview. 

2.  HEL's  PATRIOT  Display  and  Control  Simulation. 

3.  Operator  Performance  Testing. 

4.  Current  use  of  the  Display  and  Control  Simulation  and  future 
testing. 

Figure  1.  Topics  Presented 


Figure  2.  Essence  of  PATRIOT  Missile  System 
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KADAR  SET 


INGAf^EMENT  CONTROL  STATION 


ELECTRIC  POWER  PLANT 


Figure  3.  PATRIOT  Firing  Platoon 


Figure  4.  Engagement  Control  Station 
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Figure  6.  HEL's  PATRIOT  Display  and  Control  Console  Simulator 
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1.  Preprocessing  of  target-scenario  data. 

2.  Real-time  radar  display  simulation. 

3.  Data  analysis  and  operator-performanre 
assessment. 

Figure  7.  Software  Program  Categories 

The  capability  to  preprocess  target 
information  relieves  the  computer  of  consid- 
erable arithmetic  during  program  execution 
and  permits  preparing  and  checking  a variety 
of  scenarios  prior  to  actual  testing.  For 
later  access,  preprocessed  scenario  data  are 
stored  on  the  disc.  A scenario  can  contain 
up  to  54  tracks  plus  a maximum  of  45  target 
maneuvers. 

The  real-time  simulation  program  uses 
the  preprocessed  scenario  data  to  present  a 
realistic  display  of  aerial  targets  to  the 


console  operator.  The  target  data  Interact 
with  the  operator's  actions  to  simulate  the 
total  air-defense  system.  Operator  actions 
and  target  events  are  recorded  in  real-time 
for  later  analysis. 

Computer  programs  have  been  developed  to 
aid  in  evaluating  operator  performance  by 
isolating  performance  parameters  and  summar- 
izing operator  actions.  There  are  also 
provisions  for  scenario  replay  with  operator 
actions,  individual  target  history,  chrono- 
logical event  listing,  target  kill -assessment 
summary  with  Intercept  locations,  asset 
boundary — penetration  suttmary,  and  keyboard- 
action  suiimary. 

The  PATRIOT  Display  and  Control  Simula- 
tion closely  follows  the  actual  system's 
current  specifications  'or  the  displays, 
controls  and  fire  control  processes. 


Figure  8.  Typical  PATRIOT  Display 
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Figure  11.  PATRIOT  Display  and  Control  Console  Shelf 


Targets  are  identified  and  classified  as 
they  enter  the  radar-tracking  sector,  and  are 
displayed  as  coded  symbols.  Each  target  is 
then  Subjected  to  various  tests  which  deter- 
mine its  engagement  eligibility  and  threat 
eligibility.  If  a target  meets  these  cri- 
teria, further  tests  determine  which  asset 
it  threatens.  Then  a launch-decision  process 
ranks  the  target  for  engagement;  this  process 
is  based  on  location  of  the  predicted  inter- 
cept, time  urgency  tt  protect  an  asset,  and 
the  initialized  operator  time  requirements. 

If  the  operator  initiates  an  engagement, 
the  weapon-assignment  process  selects  a 
launcher  and  a missile,  and  begins  launch 
action.  When  the  engagement  terminates  in  an 
interception,  the  program  performs  a target- 
kill  assessment;  the  target  is  then  either 
"destroyed,"  or  considered  for  re-engagement. 

I will  now  briefly  describe  the  HEL- 
simulated  PATRIOT  Display  and  Controls. 

The  operator  sees  a basic  picture  like 
the  one  shown  in  figure  8.  This  is  a Plan 
Position  Indicator  (PPI)  display  which  is  on 
at  all  times.  It  shows  the  radar-boundary 
limits  for  searching  and  tracking  targets, 
and  range  rings  used  as  a guide  for  target 
distance.  Through  the  operator's  key  actions, 
additional  map  data  are  available  for  dis- 
play. These  data  include  radar-masking  ter- 
rain, air  corridors,  prohibited  areas, 
restricted  areas,  defended  areas,  and  the 
forward  edge  of  battle  area  (FEBA).  Dynamic 
elements  shown  in  Figures  9A  and  9B  appear 
and  are  updated  under  program  control.  These 
elements  include  target  symbol  modifiers, 
track  numbers,  velocity  vectors,  defensive- 
missile  symbols,  launch-now-intercept  lines, 
target-patch  history,  and  predicted  inter- 
cept points.  The  operator  has  the  option  of 
displaying  or  removing  these  elements  by  key 
action. 

Tabular  displays  appear  in  an  area  di- 
rectly below  the  PPI  display.  They  consist 
of  an  alert-message  line  and  three  mutually- 
exclusive  tabular  displays:  missile  inven- 
tory, engagement  data  which  is  divided  into 
to-be-engaged  and  engaged  tracks  and  track- 
ampl  i fying  data. 

Figure  10  shows  a complete  rather  active 
display  as  an  air-defense  operator  would 
typically  see  it. 

The  console  contains  108  keys,  of  which 
32  are  under  program  control.  Designated 
keys  also  contain  a lamp  which  is  under 
program  control  and  which  is  used  to  indicate 
the  status  of  the  condition  related  to  that 
key;  i.e.,  function  is  active  when  lati^)  is 
on.  Since  keyboard  functions  are  handled  by 
a Subroutine  or  set  of  subroutines,  it  is 


easy  to  add,  delete,  or  alter  keyboard 
functions  as  needed.  This  increases  the 
simulation's  flexibility  and  permits  testing 
alternate  key  functions  without  affecting 
the  remainder  of  the  program,  "''he  keys  are 
separated  into  functional  groups  on  the 
console  panel . 

The  console  operator  uses  an  isometric 
joystick  to  control  a PPI-display  cursor  as 
a pointer  to  hook  targets  for  further  eval- 
uation and/or  engagement.  The  operator's 
performance,  especially  in  time-critical 
situations,  depends  upon  his  ability  to  place 
and  hold  the  display  cursor  close  enough  to 
a target  for  hooking. 

The  isometric  joystick  shown  in  Figure 
11  is  a pressure-sensitive  stick  with  analog 
Output.  Unlike  the  other  devices,  the  iso- 
metric joystick  requires  relative  cursor 
positioning,  since  it  returns  to  the  center 
position  when  released.  The  rate  of  cursor 
movement  is  directly  proportional  to  stick 
displacement.  The  transformation  from  digi- 
tal output  to  raster  units  is  selected  by 
the  experimenter,  allowing  great  freedom  in 
varying  the  cursor's  movement  rate  as  a 
function  of  the  stick  pressure. 

The  experimenter  has  complete  control 
over  the  operator  testing  through  his  own 
monitor  display,  function  keyboard  and  the 
teletype.  The  experimenter  begins  the  test 
by  entering  "/SAM"  on  the  teletype.  This 
begins  the  execution  of  the  simulation  pro- 
gram, which  causes  the  computer  requests 
as  shown  in  Figure  12. 

Responses  are  entered  on  the  teletype, 
and  program  execution  continues.  The  ex- 
perimenter's display  duplicates  the  opera- 
tor's display,  and  it  also  shown  certain 
additional  information  only  to  the  experi- 
menter. This  information  includes  elapsed 
time,  scenario  number,  and  other  pertinent 
system  data  not  displayed  to  the  operator. 
Using  his  function  keyboard,  the  experi- 
menter can  also  "reload"  the  missile 
launchers  when  they  are  depleted.  The  ex- 
perimenter can  halt  the  display  at  any  time, 
for  discussion  of  critical  situations  during 
operator  training,  or  to  obtain  a hard  copy 
of  the  situation  display  shown  on  the  con- 
sole. Test  termination  is  also  controlled  by 
the  experimenter  through  the  function  key- 
board. At  termination,  the  test  results  are 
stored  by  test  number. 

Specific  programs  have  been  developed 
to  assist  in  analyzing  the  test.  These 
routines  will  display  data  on  a CRT  for 
viewing,  or  make  a permanent  record  on  the 
STATOS  printer.  Events  can  be  listed 
chronologically  or  by  track.  Other  routines 
sutimarize  the  operator's  key  actions. 
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tarqpt-kill  assessments  and  intercept  loca- 
tions, tarqet-asset  penetrations  and  operator 
hooMnq  actions.  A proqram  has  been  de- 
veloped that  will  replay  the  scenario  and 
duplicate  the  operator's  actions,  so  the 
experimenter  can  discuss  and  evaluate  these 
actions  with  the  operator.  The  playback  is 
also  valuable  as  a performance  training  aid 
for  the  operator. 

Test  results  can  be  maintained  on  the 
disc  indefinitely,  and  they  are  aci  ssible 
for  analysis  at  a later  date. 

Operator  Performance  Testing: 

I will  now  describe  the  operator  per- 
form,ance  testing  performed  on  HEL's  PATRIOT 
Display  and  Control  Simulator. 

Since  there  was  no  test  data  available 
where  PATRIOT  operator  performance  could  be 
compared,  it  was  decided  to  obtain  perform- 
ance measures  using  the  current  D&C  system 
design  to  establish  a baseline  of  perform- 
ance measures.  Once  this  was  done,  software 
modifications  were  made  to  the  design  and 
tested  to  determine  whether  they  improved 
operator  performance  over  the  baseline 
design. 

Since  time  does  not  permit  me  to  go 
into  an  explanation  of  the  PATRIOT  display 
and  control  features  and  capabilities,  I will 
describe  only  a few  of  the  modifications 
which  significantly  improved  operator  per- 
formance. 

During  our  testing  on  the  baseline 
system,  we  found  that  operators  were  having 
difficulty  in  performing  the  following  tasks 
as  stated  in  Figure  14. 

To  reduce  or  eliminate  the  above  prob- 
lems in  hopes  that  operator  performance 
would  be  significantly  improved,  the 
following  software  changes  were  made: 

a.  To  improve  performance  on  both  de- 
tecting air-to-surface  missiles  (ASMS)  and 
critical  alert  messages  (problems  a & e), 

ASMS  which  were  originally  not  threat 
ordered  were  threat  ordered  in  part;  i.e,, 
those  ASMS  which  were  targeted  within  a cer- 
tain distance  of  the  firing  platoon  were 
threat  ordered  in  order  to  improve  the  self- 
defense  posture  of  the  firing  platoon.  Thus, 
the  ASMS  which  were  threat  ordered  were  now 
put  on  the  To-Be-Engaged  section  of  the 
tabular  display  along  with  other  aircraft 
threats.  When  one  of  these  targets  met  a 
certain  criteria,  it  initiated  a blinking 
priority  engagement  visual  alert  message  to 
the  operator  along  with  an  audible  alert. 

With  this  change,  all  the  operator  had  to 
do  was  to  acknowledge  the  alert  and  issue  an 
engage  cornnand. 


In  the  basel  ine  system  there  was  no 
audible  alarm  provided  for  critical  threat 
ordered  aircraft.  At  times  the  operator  was 
not  aware  of  the  blinking  alert  message  and 
he's  had  to  depend  strictly  on  his  own 
surveillance  capability  to  detect  an  ASM 
symbol  on  the  PPI  display.  Once  the  ASM  was 
detected,  he  had  to  use  his  joystick  to 
manually  hook  the  ASM  track  before  he  could 
issue  an  engage  command.  With  the  changes, 
the  ASM  track  was  automatically  hooked  when 
the  priority  engagement  alert  message  was 
acknowl edged. 

b.  To  eliminate  the  operator  task  of 
moving  the  tabular  cursor  back  to  the  first 
line  of  the  TBE  tabular  display,  all  that  was 
needed  was  a software  change  to  prevent  the 
cursor  from  moving  down  to  the  next  line 
after  a sequence  hook  action  was  taken  by  the 
operator.  Apparently,  when  the  sequence  hook 
wax  designed,  the  contractor  did  not  remember 
thit  the  next  logical  action  an  operator 
vr-sld  take  after  sequence  hooking  a track  on 
tne  To-Be-Engaged  display,  would  be  an  engage 
action.  Once  an  engage  action  was  taken,  the 
track  on  the  TBE  display  moved  to  the  Engaged 
part  of  the  display  and  all  other  tracks  on 
the  TBE  display  were  reordered  with  the  track 
on  the  first  line  having  the  highest 
priority;  however,  the  tabular  cursor  was  now 
on  the  second  line  and  the  operator  had  to 
move  it  back  to  the  first  line  so  that  he 
could  hook  and  engage  the  highest  priority 
target.  Remembering  to  do  this  task  frus- 
trated a number  of  subjects  to  a point 
where  they  completely  refused  to  use  the 
sequence  hook  function.  I might  add  that 
once  the  change  was  made,  the  subjects  found 
that  this  method  of  hooking  was  very  effec- 
tive, especially  in  times  when  there  were 
many  hostile  tracks  on  the  display  and  they 
preferred  this  hooking  method  over  the 
manual /joystick  hooking  method. 

c.  To  reduce  the  unknown  identification 
time,  a new  tabular  display  was  developed 
that  listed  all  the  hostile  criteria  for  the 
unknown  track.  (See  Figure  15.)  All  the 
operator  had  to  do  was  count  the  number  of 
hostile  criteria  exhibited  by  the  track.  If 
the  number  equaled  or  exceeded  the  TSOP 
number  of  criteria  for  an  unknown  track  to  be 
hostile,  the  operator  designated  the  track 
hostile. 

d.  To  eliminate  the  operator  task  of 
remembering  to  select  the  Ripple  Method  of 
fire  on  a multiple  hostile  track,  the  proper 
method  would  be  automatically  selected  by  the 
computer  on  a hooked  target.  I'm  sure  this 
short  description  of  the  problems  and  the 
modifications  made  to  correct  them  leaves  a 
lot  of  gaps,  and  if  you  want  a more  thorough 
understanding  please  feel  free  to  talk  to  me 
later.  The  test  results  where  our  modifica- 
tions showed  a significant  improvement  in 
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Computer  Output 
Scenario  XX 
SAMS  XX 

TEST  CONSOLE  X 
TEST  NO  XX 

SUBJECT  INFORMATION 

Figure  12.  Computer  Output 


Meaning 

Scenario  Number 

SAM  Missiles  Available 

Test  Console  Number 

Test  Number  (warns  experi- 
menter if  number  has  already 
been  used) 

Subject  and  Test  Data 
Requesting  More  Data 


1.  To  evaluate  the  current  PATRIOT  Display  and  Control  (D&C)  Design 
for  performing  air-defense  missions  in  a benign  environment. 

2.  To  develop  display  and  control  modifications  for  improving  the 
current  display  design. 

3.  To  determine  the  effectiveness  of  these  modifications  on  air-defense 
operator  performance. 

4.  To  assess  the  adequacy  of  an  HEL  developed  Tactical  Standing  Operating 
Procedure  for  PATRIOT. 

5.  To  examine  operator  performance  under  different  target  densitites. 

Figure  13.  Operator  Performance  Test  Objectives 


1.  Detecting  and  engaging  ai r-to-surface  missiles  within  the  short  time 
period  that  these  targets  could  be  engaged  and  intercepted. 

2.  Remembering  to  move  the  tabular  display  cursor  back  to  the  first  line 
of  the  To-Be-Engaged  Tabular  display  after  hooking  a target  on  the 
first  line. 

3.  Comparing  TSOP  Hostile  criteria  with  an  unknown  track's  paremeters 
for  the  purpose  of  declaring  an  unknown  track  as  hostile. 

4.  Remembering  to  select  Ripple  Method  of  Fire  on  a multiple  hostile 
track. 

5.  Detecting  and  rapidly  responding  to  visual  alert  messages-even  critical 
alert  message. 

Figure  14.  Observed  Problems  on  Baseline  System 


operator/machlne/mlsslon  performance  are 
shown  In  Figure  16.  A total  of  16  military 
air  defense  personnel  having  varying  amounts 
of  operator  experience  of  the  HAWK  System 
served  as  subjects  for  this  PATRIOT  test. -i 
Based  on  our  test  results,  we  submitted  a 
total  of  10  reconnendations  to  the  PATRIOT 
PMO. 

Upon  completion  of  our  formal  testing 
and  preparation  of  the  report  (HEL  TM  15-77), 
it  became  rather  obvious  that  our  PATRIOT 
simulator  could  be  used  as  a training  device 
to  provide  some  advance  training  of  government 


personnel  having  responsibilities  for  OT/OT 
planning/testing  and  development  of 
training  devices.  To  date,  over  30  personnel 
from  the  PATRIOT  PMO,  OTEA,  TRADOC,  TECOM, 
and  AMSAA  have  taken  our  informal  indoc- 
trination training  on  the  HEL  Display  and 
Control  subsystem  simulator. 

The  benefits  which  can  be  realized  from 
this  effort  are  shown  in  Figure  17. 

Finally,  in  regards  to  our  future  tests 
planned  for  the  PATRIOT  simulators.  The 
topics  to  be  studied  are  shown  in  Figure  18. 
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Figure  15.  New  Tabular  Display  for  Identifying  Unknown  Tracks 
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Dependent  Variables 

Baseline  System 

Modified  Syster 

Unknown  Track  ID  Time 
*(sec) 

50.6 

33.4 

Priority  Alert  to  Acknowl- 
edge Time  “(sec) 

5.0 

2.5 

Priority  Alert  to  Engage 
Time  *{sec) 

6.0 

4.2 

Mean  Time  to  engage  FP 
directed  ASMS* 

15.0 

10.0 

‘Significant  at  .05  confidence  level  using  Tukey's  Test  of  difference 
between  the  means. 

“Significant  at  .01  confidence  level. 

Figure  16.  PATRIOT  Display  and  Control  Evaluation  Test  Results 


1.  Reduces  the  need  and  costs  of  conducting  special  human  engineering 
field  tests  on  the  actual  system  equipment. 

2.  Provides  visibility  on  human  engineering  problems  existent  in  the 
current  system  design.  Detecting  and  correcting  these  problems  now  is 
less  costly  than  when  the  system  is  fielded. 

3.  Provides  a technical  baptism  to  personnel  in  the  test  and  training 
communities  whereby  they  are  better  prepared  for  structuring  their 
respective  tests  and  defining  their  training  requirements;  i.e.,  when 
you  know  how  a system  is  to  perform,  you  are  in  a better  position  to 
prepare  a test  for  measuring  the  required  performance. 

, Figure  17.  Training  Benefits 


1.  Display  study  on  operator  capability  in  an  ECM  environment. 

2.  Task/workload  divisions  using  two  Display  and  Control  consoles. 

Figure  18.  Future  Tests  Planned 
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TOW  MISSILE  SIGHT  VIDEO  TRAINING  SYSTEM 
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INTRODUCTION 


Maintaining  a high  first  round  weapon  system  kill  probabil 
ity  through  effective  gunner  training  has  become  increas 
ingly  important  with  escalating  cost  per  round  Recent 
advances  in  the  slate  of  the  art  in  video  cameras  employing 
all  solid  stale,  charge  coupled  device  (CCD)  technology 
have  prompted  a reevaluation  of  current  training  techniques 
and  devices  This  paper  discusses  the  application  of  this  new 
technology  in  a training  environment 

The  Fairchild  TOW  Missile  Sight  Video  Camera  System 
(TMSVCS)  provides  a capability  for  real-time  monitoring 
and  assessment  of  gunnery  performance  and  immediate 
(lost  mission  [ilayback  and  analysis  of  gunner  aim  point  dur 
ing  live  or  simulated  firings  of  the  TOW  Weapon  System. 

In  this  helicopter  application,  the  gunner,  located  in  the 
front  seat  of  the  AH  IS  TOW  COBRA,  utilizes  a stabili/erJ 
Telesrrrpic  Sight  Unit  (TSU)  with  which  he  can  detect  and 
accurately  track  a target  As  an  aid  to  gunner  training,  and 
for  effectiveness  evaluation,  (irtjvisions  for  a 16mm  film  gun 
camera  form  a part  of  the  TSU  Training  benefits  of  this 
film  record  are  minimal  because  of  the  several  day  delay  be 
tween  exposure  and  screening  of  the  film  due  to  film  pro 
cessing  requirements  Additionally,  light  level  variations 
limit  the  usefulness  of  film  cameras.  Another  training  aid, 
the  Gunner  Accuracy  Control  Panel  (GACP)  displays  azi 
muth  and  elevation  gunner  errors  to  the  instructor  pilot  (IP) 
in  the  second  seat  of  the  helicopter,  but  this  system  is 
usaftle  only  with  specially  conditioned  targets. 

The  TMSVCS  overcomes  these  shortcomings  by  providing 
the  instructor  pilot  with  a real-time  image  of  gunner's  field 
of  view,  including  the  TSU  reticle,  on  a high.brightness  video 
monitor  In  a training  exercise,  the  IP  can  observe  and  ver 
bally  correct  the  way  m which  the  gunner  sights  on  the  tar 
get  artd  maintains  position  from  initial  acquisition  to  im 
pact.  Tracking  errors  and  jitter  in  azimuth  or  elevation  can 
tie  oftserved  dynamically  and  corrected  instantaneously. 

For  immediate  detailed  review  of  gunner  performance  upon 
return  to  base,  the  on  board  video  tape  recorder  (VTR)  can 
be  utilized.  The  video  tape  cassette,  removed  upon  larxling. 
can  be  replayed  on  a VTR  and  displayed  on  a video  mom 
tor  for  performance  review,  assessment  and  correction,  this 
procedure  can  take  place  much  more  rapidly  than  in  the 
case  of  16mm  film  arxf  therefore  represents  a significant 
training  aid  improvement  for  the  IP  and  student.  Relative 
advantages  of  the  TMSVCS  are  summarized  in  Table  1. 


TABLt  1. 

VIDEO  TRAINING  BENEFITS 

■ No  Tarqpl  Conrjitioninq  Requirpil 

■ Real  Time  IP  Ohservanon/Verbal  Queinq 

■ Immediate  VTR  Playback  on  Landmq 

■ 40  Simulated  Firings  on  a Single  Cassette 

■ Reusable  Tape  Cuts  Cost 

■ Short  Term  RecoiiJ  to  Demrrnstrate  Improvements 

■ Modular  Growth 

■ Operational  Value 

RECCE 

Damage  Assessment 

Lanrfinq  Airf 

TMSVCS  CAMERA  SYSTEM  DESIGN 

The  Fairchild  TMSVCS  is  made  possible  by  the  recent  avail 
ability  of  small,  rugged  low  light  level  TV  cameras,  high 
brightness  monitors,  and  video  tape  recorders  ruggedized  for 
use  in  the  helicopter  environment.  The  smallest,  most  rug 
ged  and  reliable  TV  cameras  available  employ  a solid-state 
imaging  device  rather  than  a vidicon  tube.  Fairchild  has  de 
veloped  solid-state  charge-coupled  device  (CCD)  area  imag 
ing  arrays  and  cameras  which  are  ideally  suited  to  this  re 
guirement.  Operation  at  the  low-light  levels  available  from 
the  TSU  beam  splitter  is  possible  because  of  the  superior 
CCD  sensitivity. 

The  CCD  camera  is  mounted  in  a special  bracket  which 
maintains  the  same  TSU  interface  as  the  previous  film  cam 
era.  The  dynamic  range  and  AGC  characteristics  of  the  CCD 
camera  permit  effective  operation  over  a wide  range  of 
scene  brightness  without  exposure  control.  This  provides  a 
stale  of  the  art  system  with  high  reliability  at  a modest  cost. 

The  TMSVCS  camera  is  depicted  in  Figure  1 The  CCD 
camera  output  feeds  both  a video  tape  recorder  and  high 
brightness  monitor.  TMSVCS  power  is  switched  manually 
via  a remote  switching  and  control  panel  conveniently  lo 
cated  for  operation  by  the  IP  Automatic  tape  recorder 
shut  off  IS  provided  with  a manual  override  as  a tape  saving 
feature  and  assures  that  the  recorder  is  not  inadvertently 
left  in  a RECORD  mode  for  extended  periods. 
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Figure  1 . TMSVCS  Camera 

The  CCD  television  canierd  uses  a modified  (lositioninq  ring 
ant)  retaining  shoe  similar  to  those  used  tor  ttie  film  camera 
tKjdy  This  assures  tfiat  the  mechanical  and  optical  interface 
IS  mamtamect  without  modification  to  the  TSU  Lttcaling 
the  small  CCD  format  (7  2 mm  diagonal)  in  the  16mm  film 
image  plane  ' 6mm  diagonal)  reduces  the  disftlayed  field 
of  view  to  67%.  This  provides  improved  target  resolution 
and  image  magnification  and  enhances  the  instructor's  aliil 
ity  to  assess  gunner  accuracy  at  the  projected  time  of  tartjet 
intercept 

Figure  2 shows  the  installation  of  the  TMSVCS  camera  in 
the  TSU  The  small  sire  of  the  camera  is  evident  from  the 
photograph,  and  clearly  indicates  that  the  camera  does  not 
interfere  with  the  gunner  during  TOVV  System  operation 

A performance  specification  for  the  CCD  video  camera  is 
given  m T able  2 

Higher  resolution  and  dr  a greater  field  of  view  can  be  pro 
yided  with  a full  TV  resolution  CCD  camera  as  requirements 
dictate  Specifications  for  the  full  resolution  CCD  camera 
are  given  in  T able  3 

VIDEO  TAPE  RECORDER 
AND  MONITOR  INSTALLATION 

A High-Brightness  Video  Monitor  is  mounter)  on  the  top  of 
the  gunners  seatbacli  for  viewing  by  the  instructor  pilot 
(Figure  3)  The  small  5i;e  of  the  disttlay  serves  to  minimi/e 
obstruction  of  the  IP's  forward  view  in  this  location,  and 
the  increased  visibility  offered  by  use  of  the  television  cam 
era  more  than  compensates  for  the  area  bitjcked  by  the 
monitor  The  video  tape  recorder  and  system  power 
supplies  also  depicted  in  Figure  3 are  located  in  the  sjiace 
immediately  behind  the  pilot's  seat 

RESULTS  AND  CONCLUSIONS 

The  last  four  figures,  photographed  from  the  television 
monitor,  riepict  actual  scenes  viewed  through  the  TSU/CCD 
camera  system  and  illustrate  the  jierformance  cajiability  of 
the  TMSVCS  In  Figure  4 a tank  located  at  a distance  of 
2.800  meters  is  shown  at  13  x magnification  (the  high  mag 
nification  setting  of  the  TSU)  To  the  right  in  the  figure,  a 
TOW  missile  approaching  the  target  is  tiarely  discernible  A 


Figure  2.  Installation  of  TMSVCS  Camera  in 
the  TSU 


Figure  3.  TMSVCS  Installed  in  AH-IS 
Helicopter 


few  hundredths  of  a second  later,  the  missile  strikes  the  tar 
get  and  approximately  70  milliseconds  after  missile  impact 
the  scene  appears  as  shown  in  Figure  5 The  two  magnifica 
tions  available  with  the  TOW  Sight  are  clearly  illustrated  in 
Figures  6 and  7 where  the  same  helicopter  is  shown  in  the 
air  at  a range  of  2,600  meters  at  both  magnifications.  All 
four  pictures  (Figures  4 through  7)  were  photographed  at 
approximately  9 00  AM  under  overcast  sky  conditions. 

Other  closely  related  apjtlications  for  the  same  basic  Fair 
child  TMSVCS  components  include  Aircraft  Electronic 
Gunsight  Cameras  and  potential  use  in  any  weapon  systems 
employing  optical  sights  or  as  visual  confirming  sensors  for 
other  types  of  scoring  systems.  On  board  TV  cameras,  dis 
plays,  and  recorders  should  find  increased  application  to 
reaUtime  reconnaissance  and  damage  assessment  systems  ^s 
well  as  helicopter  cockpit  disitlay  recording.  Field  dejtloy 
ment  will  continue  to  disclose  other  applications  of  the 
TMSVCS  and  further  arid  to  a growing  list  of  tienefits  of 
video  systems  in  the  institutional  and  field  unit  o()erational 
environments  \ 
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table  7 


TMSVCS  CAMERA  SPECI F ICAT ION 


SENSOR 

FAIRCHILD  CCD  ARRAY 

SPECTRAL  RESPONSE 

0.45-1.06  MICROMETER 

OPTICS 

TSU  COMPATIBLE;  FIXED  AND  VARIABLE 

FOCAL  LENGTH  OPTICS  AVAILABLE 

LENS  MOUNT 

STANDARD "C" MOUNT 

SENSITIVITY  (NOTE  11 

SCENE  BRIGHTNESS  0 0125  FOOT  LAMBERTS. 
SENSOR  ILLUMINATION  0 00125  FOOT  CANDLES 

ELECTRONIC  AGC 

;-80;1  RANGE 

GEOMETRIC  LINEARITY 

NO  CAMERA  DISTORTION 

FRAME  RATE 

30  FRAMES  PER  SECOND 

FORMAT 

244  LINES:  190  PICTURE  ELEMENTS  PER  LINE 

SYNCHRONIZATION 

2:1  STANDARD  INTERLACE 

VIDEO  OUTPUT 

1 VOLT  PEAK -TO - PEAK  COMPOSITE  VIDEO 
(RS  170  COMPATIBLE! 

VIDEO  LINE  OUTPUT 

UP  TO  500  FEET;  75  OHM 

POWER 

28M  VOLT  DC,  4 WATTS 

CAMERA  SIZE 

2-1/2"  W,  2"  H,  3-3/4"  L 

NOTE  HIGHLIGHT  SCENE  ILLUMINATION  WITH  2854^  SOURCE  (TUNGSTEN! 
USING  »/1  4 LENS  FOR  A S/N  RATIO  OF  UNITY 
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TABLE  3 


PRELIMINARY  SPECIFICATIONS 
EAIRCHILDMV  301  CCD  TV  CAMERA 


SENSOR 


FAIRCHILD  CCD  4B8  X 380  ARRAY 


PFRFORMANCF 
FRAME 
SE  NSITIVITY 

SPECTRAL  RESPONSE 
GEOMETRIC  LINE  ARITY 


•188  LINES.  380  PICTURE  ELEMENTS.'!  INE 
5X  10  ■' FT  LAMBERTS  SCENE  BRIGHTNESS’ 
b X 10  ‘’ft  CANDLES  SENSOR  ILLUMINATION 
0 45  TO  1.06  MICROMETER 
NO  CAMERA  DISTORTION  SYSTEM  PERFOR- 
MANCE IS  LIMITED  BY  OPTICS  AND  DISPLAY 


OPERATING  CHARACTERISTICS 
FRAME  RATE 
LINE  RATE 
SYNC 

VIDEO  OUTPUT 
VIDEO  LINE  OUTPUT 
AGC.  ELECTRONIC 
AlC.  fl4SPOT  IRIS  LENS 


30  FRAMES/SEC 
15750  LINES/SEC 
2 1 STANDARD  INTERLACE 
IV  P P COMPOSITE  VIDEO  (RS170I 
500  FT,  75  OHM 
■ 80  1 RANGE 
7 X lO'’  RANGE 


POWER 

CAMERA  •12VDC.5WATTS 

AC  ADAPTER  M5V.  50  400  H/ 


PHYSICAL  DATA 
CAMERA  SI2E 
WEIGHT 
OPTICS 


2 b'S"  DIAMETER  X 5 14"  LONG 
1 LB. 

STANDARD  "C"  MOUNT  LENS 


•HIGHLIGHT  SCENE  ILLUMINATION  WITH  2854”k  SOURCE  (TUNGSTENI  USING  M 4 LENS  FOR 
A S N RATIO  OF  UNITY 
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DOWNTIME  WASTES  THE  RESOURCE 


D.  E.  TUCKER 
Director  of  Logistics 
Link  Division 
The  Singer  Company 


SUMMARY 

T*  -'  oveiwM'w  f SuptKirt  ptoh 

U-'MS  n\  -f  f^rcKitjnn  jtMl  tMi*  ifnpact  ol  [J»*sigi*  to 

CxiSt  .intl  Lilv  Onts  l\>mst»cs  liiscipltne 

DOWNTIME  WASTES  THE  RESOURCE 
Logistics  No  Longer  a 'Tail-end  Charlie" 

T Ih’  Logistics  clfmmt  {>f  HKlustry  has  fflerfed  to.  in  the 
wtHtls  ol  thf  Now  Generation,  as  'the  Pits."  Logistics  (wsonnel 
have  historic  ally  t>een 

the  last  to  receive  the  word 

the  last  to  kr>c>w  at>oiit  chaf'qes 

the  last  to  have  anything  to  do  with  the  hardware 

or  the  software 

and  the  first  — to  feel  the  wrath  of  the  customer  when 
S4>nr*»thing  gri»“S  wrong  with  the  ecjuipmenl. 

Those  >tays  are  ending.  Logistics  Support  can  no  longer  Ije  a 
T ail  erxl  Charlie.  Logistics  is  commg  of  age. 

Desrqri  To  D)st  (DTC)  and  Life  Cycle  Costing  (LCCI,  given 
"lip  service"  tiy  troyer  anrl  seller  alike  for  many  years,  are  now 
formidalrle  tools  arid  definitive  requirements  on  many  of  the  more 
recent  Government  contracts.  LCC  virtually  catapults  Logistics  from 
the  twckgrounct  to  the  forefront  of  a simulation  program  arid  for  its 
ituration. 

LCC  may  serve  to  wake  up  industry  and  the  military  truyer 
alike.  Inrlustry.  from  the  stand|>oint  that  a very  significant  check 
(mini,  namely  Ltxjistics.  will  now  actively  influence  the  ifesign  and 
manufacture  of  simulation  equipment,  with  the  specific  intent  of 
ensuring  that  tfie  erjuipment  can  lie  suptKirted  in  tfie  field.  The 
military  customer,  in  that  if  he  mdeerl  institutes  and  follows  LCC 
guidelines,  he  can  literally  preverrt  the  downstream  expenditure  of 
miMrons  of  /foMars  aotJ  receive  far  lieffei.  more  reliable  aniJ  supixirl 
atile  e()uipment. 

Lofstics  Cm  Make  The  Difference 

Protier  Logistics  planning  and  implementation  of  that  iilan 
can  make  lh<*  difference  u>  whether  the  simulator  is  a resource  asset 
or  a liability 


With  ifuf»*,ising  coiui'in  tor  fuel  f**serve'j  arxJ  a national, 
fviiiefully  world  wiilr*.  effort  to  lonserve  *idturdl  resources,  if  may 
well  lx-  tfiat  tfie  Simulator  fiuilifing  will  frecome  Tomorrr>w's  fliqfu 
li'M*  The  simulator  user  will  requiri*  anrl  demand  maximum  etjuip 
merit  awadabdity. 

To  ensure  maximum  availability,  the  supiKjrt  pgieline  must 
f*’  clean  arvJ  smooth  flowing. 

Most  industrial  companies  recoqm/e  the  pyramidal  costs  that 
changes  and  delays  cause  on  their  own  prrjducts  By  this  I mean 
change  a 75-cent  resistor  in  Cabinet  A and  the  costs  multiply  for 
drawing  changes,  publications,  provisioning  lists.  s(>are  fiarts.  and 
field  service  bulletins. 

Similarly  costs  pyramid  for  the  Simulator  us<*r  whwi  unsched 
uled  downtime  occurs.  Figure  1 illustrates  the  iioint. 

With  the  simulator  tfown,  maintenance  (lersonmd.  either 
organic  or  contractor,  perhaps  btith,  enter  the  cost  picture  along 
with  the  spare  parts  re(|uirements  arxf  associateil  admimsir ative 
costs. 

In  the  meantime,  instructors  are  idle  and  the  training  sched 
ules  deteriorate.  The  most  serious  problem  lies  with  the  students 
for  with  downtime,  schedules  must  1*  altered  incurrir>g  costs  for 
arJministration.  housirig,  travel  arrangement,  twse  arxl  per  diem  pay. 
Avadabiiity  or  reassignment  billets  must  be  reshuffled  to  rneet  the 
altered  training  schedule.  All  of  this  is  backed  up  with  more  students 
arriving  or  eriroule  to  commence  trainir>g. 

Unscheduled  downtime  of  the  simulator  is  afnafot  headache 
to  the  training  commarxi. 

Three  key  factorsare  necessary  to  maintain  the  simulator  as  a 
viable  substitute  for  the  operational  ettuipment 

(U  Device  must  t)e  reliable  and  maintairiabie.  The 
sophistication  of  today's  training  devices  rerjuires  irxlustiy  to  re- 
evaluate the  metfuxfs  used  by  the  customer  in  reiiaifirxi  the  device. 
Built  in  Test  (BIT)  and  Built  in  Test  Equipment  (BITE)  iMixredures 
are  liecoming  I'ssential  for  organic  maintenance  personnel  to  keep 
the  erjuipment  on  the  line. 

(21  Data  must  tie  fully  tepresentative  of  Ih^  fiard 
ware.  (x)nf iguration  Control,  of  Ixith  hardware  and  software,  must 
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THE  COST  PYRAMID 


FACTORS  AFFECTING  THE  "OOWNTIME"  OF  THE  SIMULATOR 


Figure  1.  Cost  Pyramid 
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i»-  nxnr  iiqotously  ,itnl  <»bsrfv»*j|  liy  Mio  iT)dt»ufdCtuMM , 

vviif.  matle  m (h*-  inuM  Im-  r jO'fi/lly  .»'mJ 

.ipinopiidti'  tb.itujfS  m,iilr  lo  ot  the  vittwan* 

(3l  SiM»«*s.  Witbnol  thf  pioni-i  sp.H'-  p.iit.  <)<  thr 

MU  rn  ( t of»b(|t<MbOfi.  jni)  b>i  <J  v-  c»n-sili\  Downf  inir 

t*r»*v«'fbu>n  tili'idUy  '»low*'  tfu-  lutu'.’* 

Thr  liMjistK*-  Support  Tr‘j»u.  <>ii  thi  |o|i  (u>m  prrnjr.irn 
«/)«r-plnWr  fhunjiitr  ■!<  SM)i'  dtui  ril.MUlSn  lUf  if«l.  d"t|  folluWUUj  lh«' 

■ •.jiiipUM*nt  to  tt>«‘  .rjmdll.jtion  Mtr-.  rjn  •■osuM*  thdt  thi  LfxjistiCS  pl.io 
|)foji»-flv  ifupItMruMitrd.  fT>«)uH«>n‘ii.  .»'«!  CdiftfcJ  fo  d Mrrcr'ssfuf 
utrx  lusMiii.  r»u-  loqistKS  Suptxut  TrMM',  fully  SiUt|KUt»M|  by 
lHrn)H'ysiv**  iTMfi.tdiuniMTt , iiViM  rnsurr  tfidt  tfu*  «‘iju»pin»'fU  is  rfli.ilil*' 
.»!hI  fTMirbdiudblt',  .l.itd  .irul  hdrdvV.iu’  ,itr  conf iijuioil  propr/ily.  arid 
'.pdl*•^  .H*-  dvail.jlile  .d  tbr'  tnjhl  pruf  aod  ,d  du'  propr-r  sd*’  u*  'lr-(Kd 

Ttu*  Loqistu  s Siiptxm  T«Mtn,  prop'^'ly  IrauuMl  and  motiy,do<l. 
inakr  |b«’  ddlrfrun  i- 

New  Factors  In  Logstics 

As  I ft>»*ntu)t)«‘d  in  n>y  ()(K‘ning  slatcnuMUs,  DTC  and  LCC 
.ntt(Kluce  new  factofs  m the*  Loqisbcs  discipliiw*  whicb  will  have  a 
mofouixl  tmparl  on  thj*  fn»dht)ds  us4*d  to  develo|)d  simulator. 

It  IS  not  my  tuirimsr*  torlay  to  4'xtKnind  on  tfur  tfxxl  (jf  lw<l 
dStH-fts  of  tf>4-  LCC  t»fulosr)t»by  I'Kci-pt  to  alert  rnrlostry  antJ  (^r>v 
♦.•rnmvnt  ret>fi*sefrta! iv(.*s  aliKr  tfiat  LCC  rnay  wi’M  «(*ttuif«*  cliaimes  in 
the  rnorfus  operandi, 

Th»'  <f.d/  of  LCC  rs  U)  c/eale  JO  oppmum  systtMO  oi  iM|uit)- 
fTH?fd  tfiat  Will  meet  Ibi*  designated  stretificdtion  and  that  is  most 
cost  eff<*ctivr>  over  ds  pldrinerf  life  cycle. 

A continuous  dialogue  must  f*?  estal>lished  anti  maintained 
Ixdween  rJesignei  and  UMjistician  as  an  infrerent  part  of  the  system 
fk‘velopmc*nt . 

This  tyiH*  of  reldlitjnship  wiH  maxim»/e  jx)S$if)diliHS  foi  early 
ulentification  of  tHoblems.  thus  forcing  design-vprsus  su{)poit  trarle- 
off  ifetisions  tie  fore  tf»e  design  is  finah/ed.  Obviously,  design  is 
(taranrount  to  the  cost  of  ownership.  The  cuiient  Logistics  Soptiort 
Cost  (ISO  mortel  supplied  by  the  ()<)vefnment  to  contractors  will 
txith  assist  them  ir^  the  rtesign  process  and  (iiovide  a relative  measure 
of  ownership  costs. 

A new  design  concet>t  may  have  to  lie  alxiited  occasionally  in 
light  of  the  suigwirt  rerjuirements  on  a tiroqram  since,  in  the  trade 
off  studies,  repuirements  for  increased  inventory  management  ami 
new  or  nuxfdied  sup|x>ri  eijugiment  could  very  well  offset  the  gams 
resulting  from  the  new  design. 

Tfie  cost  drivers  are  inventory  anil  maintenance  mantx)wer 
costs.  Anythirrg  that  can  Ire  done  to  a design  to  reduce  the  range  ainJ 
itepth  of  inventory  that  must  Ire  carried  as  spare  or  reirair  parts  or 
that  reduces  the  time  repuirerf  for  preventive  or  corrective  mam 
tersarree  will  rwJuce  the  cost  of  rrwnership  to  the  user.  Whether  it  is 
an  overall  benefit  to  LCC  is  the  subpet  of  trade-offs  with  the  cost  of 
acquisition. 


A simplifietl,  but  IwSKally  true,  examrile  illustrates  the  {Xjint 

If  you  were  to  cie.ite  a new  dash  numfrer  for  a PC  Master 
r>inlfoller  Roaid.  d would  cost  the  uvr  aigiroKienately  $4,000  over 
.)  15  ye.ir  life  < yrli*.  Add  one  new  r.omt»onent  to  ifiat  PCB  and  you 
tiave  rloubleij  tfiat  crrst.  T tre  PCB  is  alyi  an  item  f)f  sutuMy  at  rrach 
bay  fo»  remove  and  retjiac  e,  yj  arid  afrout  $5.fXX)  more.  If  d is  alsrr 
iei>air<ible  at  tfu-  frase.  ad<l  $10,000  mure.  A simple  dasfi  numixff 
rfiaoifi-  .md  adduuj  rme  new  congHioenl.  and  you  fiave  cauy-d  iiy;f 
I'KlM-nddures  lo  excess  of  $73,000. 

let’s  assume  that  same  PCB  has  a failure  rate  of  once  every 
foul  yeais.  That  means  we  can  ••xpert  tfuei*  failures  dufinq  fhe 
lf>-veaf  life  ( yr.le.  The  poibcted  aveiag*-  MTTR  is  atiptoximalely  one 

fU)U» . 

Lacfi  failure  diiectly  affer.tsaf  feast  fhree  pergde  rhe  sfixJerit 
pilot,  the  instructor,  ami  the  maintenance  man.  Manhour  expen 
ditures  alvi  occur  in  ofifaming  the  refdacement  PCB,  documeotirx^ 
the  failure,  and  fi.giaifiiK}  lfie  faiU'd  txiaid 

The  total  cost  of  one  failure  every  four  years  on  RGB's 
focaterf  at  G fwvs  jassumiorj  6 smiuljlors  and  1?  master  boarrls  tier 
Simulator!  erjuates  t(i  aptxoxirrMtely  700  manhours.  At  S20/hour. 
Ifie  cost  IS  approximalely  S14,(X)0. 

From  a cost  of  ownership  stanrUxunt  we  have  committed 
over  $37,000,  and  have  not  even  corrsid»‘ferl  tfiecost  of  siwe/repair 
ixtrts,  supjMJft  eriuipment.  rjr  tiaining.  Thoy.*  $37,000  are  trarfe-off 
dollars.  Car'  $37.0(K)  !»•  spent  on  design  to  reduce  tfie  cost  of  owner 
ship  by  $37,000’  If  the  answer  is  yes.  then  LCC  is  l)eing  optimi/ed, 

Numerous  corrsirferations  must  Ixf  exercised  during  the  design 
ixo<.ess.  Lach  affecis  the  cost  of  ownership  for  the  uyr  (customerf. 
Tfx>  overall  raoKuKj  of  these  considerations  can  farx|e  from  sign 
dicanl  lo  minimal.  Here  are  a few  examtiles 

(U  New  riesign  versus  old  new  nalu»r>al  stock  numbers  and 
iiweniory  manaifement  are  exper^sive.  New  design  impacts  all  LSC 
elements. 

(21  Re()aira()ie  versus  throwaway  throwaway  may  fx?  cost- 
effective  for  opKdtional  weatK>n  systems,  but  it  seldom  is  so  m the 
simulatioir  world. 

( 3 ) ^'an •bme  tx?tween-f adores  j MTBP)  ami  Mean-time  to- 
repair  (MTTH)  - significant  siitce  they  rlireclly  influence  the  number 
of'pwpfe  rerjuired  to  sup|K>rt  the  product.  Peiy)nnel  costs  m the 
yrvices  have  greatly  increased,  even  though  the  number  of  perwnnel 
IS  less.  Indirectly,  MTBF  and  MTTR  influerKe  the  cost  of  spare/ 
repair  parts,  pulrlicalions,  supiKxt  equipment,  training,  arxl  even 
facilities.  Howevei,  over -design  can  Iw  just  as  fwd  as  under  design. 

(4)  BIT/BITE  versus  AGE  (test  and  support  equipmem) 
BIT/BITE  should  fw  maximized  for  fault  isolation  and  improved 
availability.  AGE  is  expensive  when  consirk?rii>g  multiple  jxocure- 
menis  at  scattered  liases.  BIT/BITE  also  improves  MTTR  through 
more  rapid  aixi  <Jetaile<1  fault  isolalioi'. 
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(h)  Level  uf  the  cost  ol  iei>dir  <it  the  cleiii»l  level  vs. 

otQ^tti/iilional  tinil  M>te» rn»MlMte  levels  vdnes  with  ttw  <.<’>fnplc*ity’ 
the  eiiuipotent  ami  tl>e  rei>aM  paits  which  rtuisi  Im’  Stocked  at  eat  h 
twM'  alo#jg  wdh  any  tHHulia»  lest 'sop|K)r  | eijui|Mt>eot. 

(Vsigo  tart  ruj  Inixtef  Iw*  ditecied  towdfd  jiiSt  lOeeliOM  the 
s(HH  diiatitMi  tetjuiiemeftls.  Coositler  atioos  most  In-  giveo  to  the 
iis*M  s exist  <»l  ownership  over  th«*  life  cycle  of  the  desi<|ri. 

I hav**  i*iespt>ted  a vrf  v hfodil  overview  of  v>ntr-  of  the  f.uiors 
of  the  OTC  ar'rl  L C(' syste'^'s.  Seminar s are  tHMfrq  corrrfuctrxf  all  over 
the  nation  ((tverinq  |lM‘Se  soh|e('tS  <iih1  I irtiqht  soqrtt^st  that  nukistiy 
atteml  a'>dsoP(M>ri  ffwm. 

for  ttH'  lonttattor.  I siiqi|est  ltt»*  followinq  areas  ittay  have 
%wTie  irnp.n  t on  oi*r*f  at»i>ns 

111  New  and  revised  «h-siqns  will  have  to  Iw  apptovwl  by 
Loqistics 

l?l  liTtproved  enq.oeeiinq  kiviwlitlqe  for  Loqistics  iHMwmnel 
will  In-  esserdial. 

l3)  Cost  pricioq  slrtiClijres  rnay  have  to  In  r»*viSe<l  m order 
to  Correlate  L'-KjistK  s Sop|vtrl  0)sts. 

(4)  Techftical  anil  Cxrst  f^oirosals  may  have  to  refli*<:t  very 
clearly  f>ow  tt'e  ctjntractor  truly  l>elievr*s  fns  iMiurprnent  Will  {jertorrn. 

151  HIvV  IRelialulit  y Incentive  Warrantiesl  may  increasr'  tlx- 
liability  of  tbe  contractor  enormously  if  the  etjorpmeni  d«.*Siqn  iS 
rH)t  jrtetpijte. 

(61  Organizational  structuri*s  n:ay  have  to  (m*  modifuni. 

“Downtime  Prevention"  Starts  With  the  Buyer 

Downtimf  Prevention"  shoulrl  trecorne  the  "Cost  Driver"  in 
d simulation  proqrarn.  Downtime  Prevention  rs  the  buyer's  obligation 
as  mutfi  as  d iS  tfu*  vMei 's  I would  likr'  to  briefly  ifiscoss  Sr'veral 
areas  of  potential  improvemHit  that  could  tie  irrstituterl  by  the  buyer 
arxl  whicfi  may  result  in  the  savimis  of  many  dollars  rroT  orrly  rn  the 
initial  prrrcuremeot.  Ixd  durmq  the  life  of  the  erpnpment 

dl  Application  of  Mil  Specs  HFU’s  anrf  resultant  con! 
facts  still  errntain  "simh-s  f)y  tfie  iK>ufwl."  Many  of  Ifiem  are  not  even 
iwrticularly  relevant  to  the  pfooirernent  of  srmidafion  e<|o»pmerrt.  I 
suspect  many  sirecif'cationv  are  mclurierl  in  the  HFQ  (rackaife  only 
liecause  tfxry  were  'ntUirled  in  tlx.*  precerfmg  RFO  for  afHrthei 
simijiatron  device  ami  what  was  i|i>o(l  for  one  must  Im*  qoorf  tor 
another.  I sur|t|est  a harrf  look  at  the  Sfrec  reriurrements  by  tf)i*  pro- 
arriru)  a<terK;y  and  tf'e  oiwrations  peofile  Irefore  rssuir>q  tf>e  RFQ. 

<?l  Commercial  Com^KJoents  • Tbe  overall  Loqrstrcs  problerri 
CouUI  mark'  sutrstanbally  Simpler  arnt  less  costly  by  the  incfedM*rl 
use  of  proven,  reliable  crrmmercial  componiHits  ami  ertuipment  Test 
e»|\*it)merit  is  one  siM'Cific  ar»'a  where  tf»e  use  of  commercial  off  the 
shelf  erpiiprnent  should  lx*  lurtlrer  exploretl  by  the  mibtary. 
Recently,  at  an  Army  seminar  we  wdnesserl  an  example  of  two 
tHeces  of  trrst  eijuiiMrrent  sirfe  by  Siik;  one  a corrmwrcral  unit  ff>e 
other  rr>ibiari/erl  w»lh  all  the  atiompariyirx}  sfieiitications.  Both 
(Mer.es  (Mfffrrrmerl  tire  sar^Mr  (Ob  fMiwever,  ttie  military  version,  after 
treoiq  luggerfi/ed,  furtqus  prrKiferl,  water (>r(K>le<l.  drof)  tr'Sled,  etc, 
could  ncj  InfKiei  fit  Tfuouqh  a fiatch  in  an  Army  tank  where  it  was 
re(|uired  to  !■*  userf. 


13)  Spares  Tbr-  ulentifrr  alion  arvl  selection  of  spare  parts  is 
a tedirnis,  firne  rrrnsominq  anrf  crrstly  task  Thr*  spares  prr)Visioninq 
a>nferpnc(-  alv)  pr*ifr)rms  a servicx?  to  the  aistomer  rjf  which  he  may 
mit  Im*  aware.  It  serves  to  {M>int  out  the  potentially  wr*ak  areas  in  the 
«*HUi()mr*nt  design 

However,  if  we  are  to  keep  tfw  simubitor  on  the  line,  spares 
must  iM*  dr*tei minerJ,  Seli‘Cteil,  piocufi'fl  amf  fhr*  contract  nr*(}otiati*rf 
iri  a more  timely  fashion 

If  mote  commercial,  off  the  shelf  type  conUMmeots  were  oserl 
in  Simulators  ' d iwntuncf"  could  Im*  miiMoved  by  permitting  rnilitai  y 
l»*rsonr)el  b.>  procuir*  cr)mponents  at  the  lr)r.al  F^adio  Shat  k outlet 


The  Logistics  Support  Group  Can  Do  More 

Fiorn  tlx'  t.onlf ardor  s sefe  of  tfx*  [)owntime  Prevention  prob 
lem,  I would  sucj(|est  that  tlx*  Logistics  Suppoi t Gtoupr.anrfo  mr)fe 
if  one  oi  mote  of  Ihi?  folUrwintj  weir*  s».*l«*(:tively  rovi'*wi*rl  tn-house 

(11  Otganr/ation  Slrurture  • It  is  very  ptol>d(i(e  tfiat  many 
Comparxes  r epresr-nterl  (x.*re  today  have  cteatetl  oigani/atirm  struct 
ures  in  orefr'r  to  do  business  with  rhe  Government.  Logist»r;$  group 
■nqs  may  have  lx*en  one  of  these  ortjdriizations.  I Miqr|i?st  that  a 
rr'view  of  your  orijani/dtxmal  Structure  may  result  m a more 
Iviinoqenous  (jtoupn'q  which  will  fx’lter  s<.*rve  your  conipany,  as  well 
as  Ihi*  customer,  and  provide  a better  itieans  of  support  for  the 
^•(lul(»men! 

(i?)  Personnel  A well  known  commercial  comfiany  uses  the 
slo<|an,  "Tfx*  Ouabty  G(x*s  In  Beftxe  the  NaiTx*  Goes  On".  We  might 
weff  kee(J  that  rn  muKf  when  5elr.*ct/rx^  /wsonnel  for  the  Logistics 
Sui>|X)r!  Team  Maximum  availalxldy  of  the  simulatm  may  require 
ijixjiixfing  anti  retraining  of  Logistics  (x»ry)nnel  - lK>th  in  manage- 
ment and  labor  categories.  Make  the  Logistics  orgarx/ation  om;  that 
l)eo|)le  will  want  to  join. 

(3)  Design  Approach  With  the  infrorluction  of  LCC  re- 
HUirernents,  d freconies  necessar  y f<rr  tfx*  Logistics  ort|an</afron  to 
(>ave  rfesign  approval  I would  suggest  that  this  riMiinrement  lx*  fully 
ex()laine<f  to  all  (M?rsonnel  active  on  a ifiven  program  jixl  then  irgidly 
enforcetl. 

(4)  (!x)m(Hitef r/dtion  Many  of  tlxi  Logistics  functions  such 
as  prtivisionrng,  sf)arr*s,  AGL,  Reliability  aixl  Mdiniainabilil y are 
heavily  corrcerrxxl  with  statistics  and 'or  numerical  aixl  alpha  listings. 
The  manual  nuMJltifxi  and  correlating  of  Logistics  data  is  not  only 
time  consuming,  iMd  a>stly. 

If  you  have  no!  already  dotx*  so.  I would  strongly  .iijv  you  to 
apply  st>me  of  your  lM*st  software  fieople  to  the  task  of  comiKit 
t?fi/iiK}  the  Logistics  data  tasks  A couple  of  gosxl  piogramming 
IN^o(>te  in  your  Logistics  giou(i  coulil  comvivably  s*ive  you  arxl  your 
customers  a consid«*i able  sum  of  money. 

lb)  Consult  Your  Customer  Insist  on  ynur  U>gistics  ti*am 
<|orrM(  to  l)»e  fielrl.  Intervii'W  the  tiser  of  yom  eriugxruxil  F uxl  out 
what  sup|M)rt  ilata  hr*  rrrally  us»*s  to  niaintain  the  e(iuipmr*ni  Sr‘»' 
which  (loairTients.  such  as  maintenance  jimI  oiM'ratton  manuals,  havi' 
dust  on  therti  arxl  fitxl  out  why.  In  this  manrK't . Yr)u  can  help  the 
(ustorner  aixl  yoiirselvr*s  arxl  perphaps  rrxfuce  some  of  the  unneces 
sai  V rrM)uiremetits  of  simulator  contracts. 
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Summary 

To  my  r»*toa»kv,  n^y  I SMTiply  statr  that  i* 

olatuH>  IS  goioq  to  fviHy  answer  the  resource  c<K>sr’rvdtion  iirotricm. 
ItHliStics  roust  an<l  wiH  play  a ouirh  ()tedt(M  arwl  roore  notioftant  role 
lo  ttH’  overall  procuren^eot  t>rocess. 

li>qistirs  can  mi  loiKjei  tn*  a “T<iiU‘rul  Charlie",  frut  rnrrst  tx* 
fully  involved  an<1  ((K)ni/ant  of  ttie  front  end  piar^nmq  and  design  of 
simulatior'  devices  ami  must  continue  ftirough  the  entire  program  to 
nn>nft<ir  arnl  rmplement  the  action  to  prevent  drjwntime  from 
Wasting  the  reviurce. 

t)TC  ami  ICC  can  tie  uwful  resources  to  lK>th  huyer  arwl 
sr-llet  I*  tt^ey  are  admirusterwl  uniformly  aixl  proiierly.  If  jllowerl  tc) 
itoteerl  in  an  uncontrolled,  frei’  rurming  state,  they  will  serve  no 
«KH*,  hut  will  develop  another  "cultism"  to  swell  the  arlnnnistrative 
tKlr‘. 


Ttie  military  fxiyer  must  tM>  arnenatile  to  iHjyiriq  less  than  the 
"(told  tuick  " I strongly  urge  tfiat  tlie  wholesale  firolifer atioo  of 
stxK'dications  used  on  government  r:ontrarts  should  lie  sfiarply 
cur  lied. 

Thr*  us*’  of  r'Stahlishr’d.  reliatil*’.  commerr  lal  off  the  shelf 
(HfMliKts  slxiuld  In*  encouraited  Methods  should  tie  develrgxxl  try  the 
mihtary  us*fr  to  ertafrlc*  firocuremenf  of  rtimmefi<i#l  a>m{*oner»tS  in 
local  areas 

Simulation  devices  are  im{K>itdot  trx^ls  to  oui  nation's  rle 
fense  not  only  as  a methrid  of  consrrrvioq  our  national  resources. 
t)ut  as  a vialrle  sutistitute  m keignng  ()ur  armerf  forces  "missirMi 
ready." 

Logistics  can  make  ttx*  difference. 


IndusTiy  should  rcsixind  to  the  need  for  nxire  reliafile  ami 
niaiiddindfile  etjugirnent  tiy  developing  a sourxl  Logistics  organi 
/ation  r.apahle  of  implementing  and  following  through  on  (jood. 
aimmcKT  s«*nse.  economical  Logistics  plans. 
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QUAl  ITY  ASSlIRANCf  AND  RF  VAL  IDAT ION : THF  CHALLFNGF  TO  MANAGFMCNT 

K.  LARRABF.F 

Naval  Fducation  and  Traininq  Pronram  Development  Center 


I NT_Rpmic.UP'’ 

The  training  device  Quality  Assurance 
and  Revalidation  Program  (QAXR)  as  operated 
hy  the  United  States  Navy  represents  a unique 
approach  to  assuring  adequate  training  device 
petformance.  This  program  applies  to 
training  eguipo'ent  ranging  from  flight  and 
weapon  systems  simulators  to  aviation 
physiological  training  systems  such  as 
ejection  seat  trainers  and  altitude  low- 
pressure  chambers. 

The  Quality  Assurance  and  Revalidation 
program  had  its  beginnings  in  1967  when 
Admiral  Moorer,  then  Commander- In-Chief  of 
the  Atlantic  Fleet,  had  training  device 
effectiveness  reviewed  to  determine  just  how 
well  training  devices  were  fulfilling  the 
Navy's  needs.  The  result  of  these  original 
and  early  inspections  was  an  internally 
operated,  integrity  inspection  system. 

Later,  in  1969,  Chief  of  Naval  Operations 
(CNO)  issued  the  first  instruction  implement- 
ing a Quality  Assurance  and  Revalidation 
F'rogram.  The  latest  Chief  of  Naval 
Operations  Instruction  defines  Quality 
Assurance  as  a "planned  and  systematic 
pattern  of  actions  necessary  to  provide 
adequate  confidence  that  training  devices 
will  continue  to  perform  satisfactorily." 

As  pointed  out  by  the  theme  of  this 
conference  ‘Resource  Conservation  Through 
Simulation,"  the  simulation  of  weapons  and 
flight  systems  can  provide  significant 
reductions  in  the  cost  of  training  and  the 
maintenance  of  needed  operational  skills. 
However,  without  some  guarantee  that  training 
Systems  and  simulators  provide  accuratir' and 
up-to-date  training,  there  exists  a real 
danger  of  providing  inadequate,  negative,  or 
dangerous  training  through  improperly 
operating  simulators  and  trainers.  By 
pursuing  an  active  and  vigorous  Quality 


Assurance  and  Revalidation  Program  throughout 
the  Navy,  the  Chief  of  Naval  Operations 
provides  adequate  safeguards  so  that 
management  will  be  informed  should  training 
device  or  simulator  capability  fall  below 
established  minimums. 


OBJCCTIVFS 

The  primary  objective  of  the  QARP 
program  is  to  provide  confidence  in  a 
device's  performance  and  its  ability  to 
provide  adequate  training  within  a 
given  environment.  To  accomplish  this 
primary  objective,  several  major 
elements  are  necessary. 

These  major  elements  are: 

a.  Ensure  that  training  devices  operate 
within  prescribed  technical  and 
operational  acceptance  criteria  and 

meet  the  training  mission  requirements 
of  the  training  agent. 

b.  Improve  safety  in  operations. 

c.  Provide  feedback  data  for  continual 
improvement  of  the  logistic  support  program. 

d.  Improve  maintenance  and  support 
techniques  and  procedures. 

e.  Uphold  the  material  reliability  and 
integrity  of  training  devices. 

f.  Forecast  requirements  for  overhaul 
and/or  modernization. 

g.  Maintain  a continuous  training  device 
status  record. 

h.  Identify  action  to  correct  device 
deficiencies. 
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'IE  ThODS 


Thf  CE'if'E  ot  Naval  Operations  has 
designated  Cornander- in-Chief  Atlantic  fleet, 
Conrander- in-Chief  Pacific  fleet.  Chief  of 
Naval  Reserves,  Chief  of  Bureau  of  Medicine, 
and  Chief  of  Naval  Education  and  Training  as 
training  agents  and,  as  such,  has  directed  them 
to  participate  in  the  Quality  Assurance  and 
Pevalidation  Program.  The  Chief  of  Naval 
Education  and  Training  was  designated  as 
overall  program  coordinator.  Participation 
of  the  Marine  Corps  is  directed  by  the 
Conrandant  of  the  Marine  Corps. 

Pesponsibi I i ty  of  the  training  agents  with 
regard  to  the  QAiR  program  may  be  delegated 
as  appropriate,  but  not  below  the  third 
echelon  level  of  command. 


At  the  appropriate  level  of  comand,  a 
qualified  officer  is  designated  as  senior 
inspector  for  a particular  device  inspection. 
Since  simulation  techniques  employ  a wide 
range  of  technologies,  a technical  advisor 
is  provided  by  a CNET  field  activity  to 
assist  the  senior  inspector  during  the  QAAR 
review.  During  the  inspection  of  the 
training  device,  the  senior  inspector 
coordinates  the  user's  evaluation  of  the 
training  systen'  by  observing  the  device  in 
operation  in  a fully  manned  situation  after 
which  both  user  and  operator  personnel  are 
debriefed  for  coiinents  concerning  operation, 
utilization,  and  any  required  product 
improvement.  The  technical  advisor  provides 
inspections  of  trainer  systems,  computers, 
environmental  systems,  and  logistics  support. 


Following  the  conclusion  of  the 
inspection  all  participants  are  debriefed  as 
to  the  findings,  and  action  items  are 
delineated  for  assignment  to  various 
commands.  A comprehensive  report  of  the 
findings  and  recomnended  actions  is  prepared 
by  the  senior  inspector  and  the  technical 
advisor  for  submission  to  the  training  agent. 


THE_REPPRJ 

The  QAiR  report  resulting  from  a device 
inspection  is  the  action  document  of  the 
program.  The  report  not  only  contains  all 
findings  of  the  QAiR  inspection  team,  but  it 
contains  action  item  assignments  made  by  the 
team  to  supporting  activities  for  resolution 
of  problems  found  during  the  inspection.  The 


body  of  the  report  contains  five  major 
cateoories,  which  are: 


a.  Activity  Evaluation:  The  activity 
evaluation  portion  of  the  report  consists  of 
observations  noted  by  an  actual  crew  test  of 
the  training  device  in  operational 
conditions.  Discrepancies  are  noted  from  an 
operational/util  ization  and  operator/ 
instructor  standpoint. 

It  is  during  this  portion  of  the 
QAAR  that  the  senior  inspector  and  all  the 
device  using  activities  evaluate  the  trainer 
for  its  ability  to  provide  useful  training  in 
the  appropriate  realm.  In  the  case  of  flight 
and  weapons  simulators,  this  portion  of  the 
report  provides  a review  of  the  device 
capability  to  replicate  the  real  world  in 
both  form  and  function. 


b.  Logistic  Support : During  the 
logistic  support  review,  all  major  elements 
of  maintenance  support  are  investigated. 
Included  are  the  training  device 
documentation  systems  such  as  handbooks, 
schematics,  and  parts  lists.  Also,  since 
most  major  training  devices  and  simulators 
now  use  digital  computers  for  a major 
portion  of  the  simulation,  all  programming 
documents  are  reviewed.  These  documents 
consist  of  operational  program  data  for 
simulation  use  and  supporting  logistics 
programs  for  computer  and  device  systems 
repair.  During  this  portion  of  the 
inspection  particular  parts  problems  are 
investigated  and  any  chronic  supply  problems 
are  noted.  Along  with  these  elements, 
training,  manning,  and  support  equipment  are 
reviewed  for  adequacy. 


c.  Systems  Test:  The  systems  test 
portion  of  the  inspection  report  consists  of 
the  actual  revalidation  of  the  training 
device  performance.  This  revalidation  is 
based  on  test  criteria  either  generated 
especially  for  QASR  or  criteria  used  for 
original  acceptance.  Special  attention  is 
given  to  discrepant  areas  discovered  during 
the  activity  evaluation  to  determine  the 
cause  of  any  improperly  operating  systems. 
These  tests  constitute  the  detailed  type  of 
inspection  to  determine  any  unusual  areas  of 
wear  and  suggest  the  need  for  special 
maintenance  attention  or  overhaul 
requirement. 


132 


d.  Configuration;  In  modern  training 
devices  configuration  testing  can  be  applied 
in  a number  of  areas.  The  most  obvious  test 
of  configuration  is  the  one  established  as 
replication  of  the  real  world.  In  the  case 
of  aircraft  and  weapons  simulators,  this 
portion  of  the  report  is  prepared  by 
comparing  real  world  operational  equipment 
changes  to  the  simulation  system.  The  report 
will  generally  state  which  real  world  system 
is  beinu  simulated  and  what  operational 
differences  exist  between  the  real  and 
simulated  systems.  In  a training  device, 
other  configurations  to  be  deteniiined  and 
maintained  include  the  configuration  of  the 
digital  computers  and  any  dedicated 
processing  systems.  With  the  number  of 
different  configurations  of  the  same  computer 
systems  now  being  encountered  in  training 
devices,  actual  configuration  can  sometimes 
be  a significant  support  factor. 

e.  F'roduct  IniprovOTienJ; ; The  final 
portion  of  the  report  deals  with  required 
product  improvement  for  the  training  device, 
[lerrents  contained  in  this  portion  of  the 
report  are  results  of  several  separate 
investigations,  first,  various  modification 
systems  which  represent  the  actual  equipment 
that  is  being  simulated  are  reviewed  for 
applicable  changes  to  the  training  equipment. 
These  include  airframe,  avionics  and 
powerplant  changes  for  aircraft  simulators, 
and  include  several  other  methods  used  by  the 
Navy  to  modify  actual  weapon  systems,  ships 
or  equipment.  Also,  during  this  portion  of 
the  report,  operator  and  instructor  personnel 
are  interviewed  for  any  change  requirements 
in  the  trainer  which  may  enhance  or  add 
needed  training  capability.  Any  maintain- 
ability or  reliability  modifications 
necessary  to  increase  effectiveness  or 
reliability  are  also  investigated  and 
included  for  action  in  this  section  of  the 
report. 


ACTION 


Upon  completion  of  the  inspection,  the 
senior  inspector  and  technical  advisor 
conduct  a debrief  for  all  personnel  involved 
in  the  inspection  or  on  site  device  support. 
During  this  debrief  all  sections  of  the  QAAR 
report  are  reviewed  for  accuracy. 


At  this  time,  action  assignments  are 
determined  to  correct  the  discrepancies 
included  in  the  report.  Through  the  report, 
various  activities  involved  in  support  of 
the  training  device  are  assigned  action  to 
respond  to  the  findings  of  the  inspection. 

The  decision  of  action  item  assignment 
responsibility  is  based  on  which  activity 
can  best  resolve  the  problem  discovered, 
following  this  debrief  the  senior  inspector 
and  technical  advisor  prepare  a formal 
report,  with  action  assignments,  for 
submission  to  the  appropriate  training  agent. 

Under  present  QA&R  instuctions, 
activities  with  actions  assigned  have  60 
days  from  the  date  of  the  inspection  report 
to  respond  by  letter  to  the  training  agent 
with  action  taken.  Action  assignments  are 
reported  every  60  days  until  resolved, 
figure  1 depicts  the  flow  of  the  report 
submission  and  action  item  response. 


(MU^  Of 
M ONS 


STATUS  Of  ' Hfff  SfH  VCO 
ACTI0^S  AMtCIlH'i 
UPFkAHONS 


I 


\ 

I 

I ACTION 

I 


I HI  ? 
LOU 


I 

I 

I 

I 

t 

I 

( 

I 

I 

i 

__  f 

CM[f  f ■ f VA.AI  ;5, 

lAipf  .ujAH  ' AM)) 

' Miii  . ■ A-.Ai  • . • . s an; 

, • •i  '-R  ’ 

I A'l'*.  • ’WAlSlS. 

■ .If.  : ' iv 

v.AL  iR*:s:v.  f ■••HI 
(IMl-f 


Figure  1.  Report  Distribution  and 
ACTION  ITEM  RESPONSE' 
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It  is  siqnificant  that  the  (jASiK 
inspection  team  is  not  involved  in  any 
acMon  taten  to  correct  the  problems  found, 
nor  the  necessary  response  to  the  traininq 
aqents.  These  are  manaqement  oriented 
actions  between  organisations  supportinq  the 
device  and  the  training  agent.  This 
procedure  preserves  the  needed  objectivity 
ot  the  QA^K  team.  Also  note  the  response 
chain  from  the  training  agent  to  CNO.  This 
line  of  communications  is  established  to 
provide  data  concerning  the  status  of 
unresolved  discrepancies  affecting  training 
device  operation.  This  line  of 
communication  provides  a built-in  warning 
system  since,  in  instances  where  use  of 
operational  equipment  is  being  avoided  by 
simulation,  a substantial  impact  on  funds 
requirement  may  be  encountered  if 
simulation  equipment  problems  are  not 
quickly  resolved. 


THE  CHALLENGE 

It  is  at  this  point  that  the  QA&R 
report  becomes  strictly  a management 
document.  The  challenge  to  management  is 
simply  this,  prioritize  and  apply 
appropriate  resources  to  the  action  items 
assigned  by  the  QA&R  report.  Management 
must  always  bear  in  mind  that  QA&R  in 
finding  discrepancies  and  assigning  them  as 
action  items  to  those  best  suited  to  solve 
the  problems  is  not  engaged  in  simple  fault 
finding  but  rather  attempting  to  assign 
action  to  the  organization  best  suited  to 


resolve  the  problem  and  assure  equipment  in 
proiier  order  to  facilitate  training.  There 
may  be  times  when  action  item  assignments 
made  by  QA&R  may  appear  to  be  embarrassing 
but  manaqement  must  maintain  a professional 
attitude  towards  these  action  iter' 
assignments,  and  be  assured  that  the  Q&AR 
inspection  aim  is  optimum  device  operating 
capability.  Tfie  senior  inspector  and 
technical  advisor  who  complete  the 
inspection  and  the  report  are  only 
interested  in  properly  operating  and 
supported  devices  that  reflect  current 
training  need  and  conf iguration.  As  with 
any  quality  assurance  organization,  nothing 
can  be  accomplished  to  correct  improper 
operation,  defective  systems,  or  poor 
logistics  without  constant  and  vigilant 
management  attention. 

Resource  conservation  through 
simulation  is  an  attainable  goal  but  only 
provided  that  simulators  and  training 
systems  provide  accurate,  up-to-date,  and 
continuous  simulation  through  proper 
logistics  and  attention  to  training 
requirements.  Without  these  elements  the 
use  of  simulation  becomes  dangerous,  unsafe 
and  conserves  nothing.  To  provide  accurate 
simulation  is  the  goal  of  all  commands 
using  simulation  as  a means  to  provide 
operational  training.  The  Quality  Assurance 
and  Revalidation  system  is  the  only  third 
party  reporting  organization  providing 
action  data  to  these  coiiriands.  Management 
action  on  QA&R  reports  can  and  must  provide 
better  and  more  accurate  use  of  simulators 
and  simulation  systens. 
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AHS  rit.\f  I 

III  tolas  viMial  tft  l«niliii;.V  Iticic  arc  inanv 
(laraiTu  ti  rn,  the  \aUii->  ot  wtiirli  nuist  In  i.-orn-cllv 
i tiii'fii.  til  a<  hicsr  an  flfi'ct is i-  sisnal  trainitn’,  -ini- 
iilat  -f.  sornt-  ol  tliot-  parann-tt-r.-'  an-  n’snlutipii, 
l•t■l^;^Iln^■- i-iir.tiai-l  latm.  real  unaui-  vi-rsu--  in- 
lliilts  imam',  c-olliination.  1 u-M  ol  s'lnss , field  of 
s less  aaps,  realii-iii,  tarui't  and  ari-a  of  interest 
III  Ids  ot  s ii-ss , ieti  i talilllts  and  aireraft  iliseern- 
iliilils  relatise  to  slant  ranne.  True  |M'rspeetive 
and  scene  continuity  across  luxtaposed  channels 
also  are  ini|)Ortant  parameters  and  are  the  subject 
ot  this  reiiort. 

II  sinstle  displays  are  used,  scene  continuity 
and  true  i>ersiK‘Ctise  is  not  usually  a prohleni  but 
most  sside-anitle  visual  systems  today  are  com- 
poseil  ot  several  0))tical  ss  indosvs,  projectors  or 
monitors  to  form  a wide  field  of  vii'sv  svhile  retain- 
init  K'skI  resolution. 

U hen  a sfiectiication  require.s  jaxtaiiosoil  dis- 
plays, the  liesi^;ner  must  solve  the  problems  of 
scene  continuity  with  distortion-free  persixictive. 

INTKODL'CTKtN 

rhe  intent  of  this  paper  is  to  show  the  ad- 
vantaites  of  uslnn  a computer  neneratcd  imaj^e 
^;enerator  ((TJI  or  C’K'i)  in  a juxtapo.seil  display 
system  relative  to  scene  continuity  with  persixic- 
tive. This  will  Ixi  done  by  illustratinK  present, 
past  , anil  future  visual  systems. 

Kl.'NCTKi.NAl.  CIIAIUC  TKKLSTICS 

C'lil  lechiioloio'  inherently  allows  the  exten- 
sion of  fielrl  of  view  through  the  u.se  of  juxtaposed 
display  channels.  Prior  to  the  u.se  of  computed 
Imagery,  extension  of  the  field  of  view  required 
the  use  of  wide  field  o|)tical  proties  coupled  Into 
sin>;le  or  multiple  cameras.  The  o|)tical  tradeoff 
necessary  to  achieve  wide  fields  of  view,  and  depth 
of  fixius,  led  to  hlnh  sensitivity  [lerformance  re- 
quirements and  accompanying  siijnal-to-nolse  limi- 
tations in  the  video  cameras.  Although  a few 
orKani/.ations  have  made  successful  advancements 
in  this  area,  the  physical  constraints  of  the  tech- 
nol<.(Ky  “re  ImpirsinK. 

The  CTil  technolojiy  released  many  of  these 
constraints  but  at  the  same  time  brouKht  some 


challennes  ol  its  own.  I n appreciate  tlxi  ('<ii  con- 
li  ibulion  to  wide  field-ol-view  simulators,  through 
tlie  u.se  111  multichaimel  displays,  i onsider  the  pre- 
vious systems  discussed,  all  nl  which  are  m ilti- 
chaniiel  \isiial  systems.  W ith  that,  i-ouph  vour 
knowTediti'  ol  other  similar  iiixtaposed  mull ieiiannel 
systems  niAv  Ix'intt  used  in  successful  trainini;  ap- 
plications. Whether  the  imane  i;eneration  is  foii- 
tact  .Analou,  Sl'tl,  lilti,  t'KI,  ordd,  or  a combi- 
nation ol  one  ol  these  with  a camera  system, 
computed  imaitery  was  the  Uisis  for  extension  to  a 
wide  lield  of  view  in  the  vast  maiority  ot  tixlay's 
successful  multichannel  simulators. 

It  is  iiilerestinit  to  consider  what  constraints 
computed  imagery  tiees  and  if  it  imposes  con- 
straints of  its  own.  I'o  answer  both  questions, 
consideration  must  Ik'  nivcii  to  the  projection 
geometry'  of  the  (Xd  system  and  Ikai  it  relates  to 
the  display  system  in  each  case  of  the  previoasly 
discassed  multichannel  simulators. 

first,  however,  a review  should  be  made  of 
what  a cm  system  is  and  how  it  works. 

CTCi  .SYSTKM 

The  computer  imane  generator  consists  of 
three  major  data  processing  cycles  run  concur- 
rently, one  in  the  Keneral-purpose  processor  and 
two  in  the  special-iiurpose  processor.  The.se 
computation  cycles  are  slaved  to  the  update  rate 
and  are  repeated  each  1/30  second  correspoiidinn 
to  the  ujxlate  rate.  The  three  cycles  are  con- 
nected serially  and,  therefore,  are  referred  to  as 
Frame  I,  Frame  II,  and  Frame  III  oiK-rations. 
These  relationships  are  shown  in  Fij^ure  1 . ( The 

term  "Frame"  is  u.sed  here  for  equipment  and 
computation  itroupitiHs  and  should  not  lie  cimfuscd 
with  update  rates.)  Frame  I ofK'rations  are  iier- 
forined  by  software  pronranis  resident  in  the  gen- 
eral-purpose computer  system.  A typical  system 
consists  of  a single  priK-essor,  peripherals,  and 
software. 

The  primary  purpixse  of  tlx?  visual  simula- 
tion software  (V.SS)  is  to  provide  overall  control 
for  the  .system  durlii);  the  real-time  oixtration  of 
a mission.  I’o  accomplish  this  purpose,  the  VSS 
must  perform  the  following  major  functions: 

a.  Acquire  vehicle  and  moving  mixlel 
position  and  attitude  information  and 
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MjCure  I.  Imap’  G«-nerator  Block  LNaKT^m 


136 


translaU-  thi'  information  into  thecoorclt- 
nau^  sot  ami  priK-essint;  cycle  of  the 
imaite  prix'ossinu  hantware. 

h.  Initialiire  thi-  active  itamini;  area  data 
base. 

c.  Monitor  controls,  acquire  ami  interjiret 
commaniis,  an<l  implement  any  action 
rtxjuired. 

(1.  Transfer  data  and  commands  to  the 
special-purpose  imane  pnxjessor  and 
mordtor  proc•essin^;  status,  implement- 
ing any  rixjuired  actions  defined  tiy  sta- 
tus or  ojicrator  commands. 

In  aildition  to  tlx'se  real-time  functions,  the 
pr<K-ess  of  preparing  the  sysU'm  to  execute  a mis- 
sion has  also  Ix'cn  assitpieil  to  the  VSS.  The  data 
received  from  the  primary  computer  over  the 
computer-to-computer  interface  consists  of  environ- 
ment controls  (l.e.,  cloud  parameters,  \1slhllltv, 
liUhtiiiK  .selection,  etc.);  discrete  controls;  and 
pasition  and  attitude  for  the  (articular  vehicle, 
such  as  aircraft,  tank,  seacraft,  etc. 

The  \'.ss  tlxui  prixesses  these  inputs  to  gen- 
erate data  for  the  T rame  II  and  frame  III  ofiera- 
tions.  I\vo  special  data  buses  provide  tlie  com- 
munication links  to  all  functions  within  frame  II 
and  I'rame  III  for  the  nenerahiiurpo.se  comiiuter. 
These  Im.ses  are  used  for  on-line  transfers  liurinn 
real-tiiiic  scene  neneration  and  for  off-line  test  and 
diannostic  data  transfers. 

The  frame  II  computations  process  a new 
two-dimensional  imane  for  each  display  channel 
duruiH  every  raster  [leriixl.  The  display  channel 
imanes  are  true-persiicctive  scenes  of  the  mixleled 
environment  as  viewed  from  tiie  current  position 
ami  orientation  of  the  viewiioint  and  display  chan- 
nel view  [ilanes.  The  view|)olnt  an<l  movinn  m<xlel(s) 
(losition  and  orientation  data  are  received  from  the 
visual  corniiuter  at  the-  start  of  each  raster  (leriod 
as  a l)l<K'k  of  edne  data  words  and  as  a block  of 
point  llHht  data  words.  The  nuinlxir  of  words  may 
vary  from  1000  to  10,000  dc|iendlnH  on  the  apidlca- 
tlon.  A face  priority  list  is  also  transferred  to 
frame  III  at  the  start  of  each  raster  (lerUxi.  The 
face  priority  list  contains  the  relative  priority  re- 
lationships of  the  faces  Ixiunded  by  the  ednes  in  the 
eiine  data  word  bhx-k. 

Tin-  frame  III  function  converts  two-dimen- 
sional imane  <lata  received  from  frame  II  into 
composite  video  that  is  synchronized  to  the  display 


raster  scan.  'Tlx‘  frame  III  hardware  then  outfiuts 
iqi  to  oinht  channels  to  the  <lLs|)lay.s. 

DKTAIUS 

With  an  understandInK  of  the  CKl,  we  will  now 
return  to  the  details.  Projection  neometry  is 
shown  in  flRure  2.  The  data  liase,  a mathemati- 
cal model  of  the  environment,  is  transformed  to  a 
tw  (»-ilimen.sional  imane  [ilane  hx-aU-d  at  some 
defined  iiosition  with  resfiect  to  an  eyepolnt.  The 
atiHles  subtemled  by  this  imane  plane  at  the  eye- 
[loint  are  the  field  of  view  of  a single  compuU-d 
channel.  (It  is  analonous  to  the  photo-sensitive 
surface  of  a video  camera  in  a carnera/modcl  sys- 
tem. ) To  extend  the  field  of  view,  it  is  merely 
necessary  to  add  imane  planes  forminn  a poly- 
hedral array  with  the  eyepoint  at  the  neometric 
center.  'This  is  analogous  to  a camera  system 
containinH  a concentric  array  of  lenses  ami  cam- 
eras. PackinH  constraints,  finite  separations  or 
overlajis  at  the  channel  Ixiundarie.s,  and  distortions 
at  the  txiundaries  limit  the  extension  of  camera 
systems  to  multiple  channels.  None  of  the.se  con- 
straints of  limitations  is  inherent  in  the  computed 
imanes.  Distortion  is  neHlilJlhle  since  the  trans- 
formation from  the  data  base  to  the  imane  planes 
is  limited  in  accuracy  only  by  the  numixjr  of  bits 
cho.sen  for  calculating  the  projections  and  defining 
the  im;4te  planes. 

Sub.sc-quent  to  the  initial  transformation  from 
the  data  base  to  the  imane  plane,  the  Ct'd  system 
(xirforms  additional  important  functions,  for  ex- 
ample, (lerception  of  the  third  dimension,  depth, 
is  preserved  by  determininn  the  priority  of  envlnn- 
mcntal  models,  lights  anil  terrain.  Another 
important  function  is  the  transformation  of  the 
image  to  a raster,  which  allows  video  transmis- 
sion and  display. 

The  dlsiilay  devices  u.sed  in  the  multichannel 
juxtaposed  systems  are  generally  designs  of  moni- 
tors or  projectors  whose  components  were  initially 
develo))ed  for  television  or  radar  applications. 

These  are  combined  with  s|)ecial  ofitical  systems 
develo|>ed  primarily  for  simulation  a|>plicutions. 

One  of  the  simplest  of  these  eomblnations  Is  illus- 
trated by  iK'vice  21135  'Training  System.  In  the 
2B35  system,  figui-e  3,  juxtaposed  projection 
screens  combine  tlx'  linages  and  repre.scnt  a 
simple  unity  transformation  of  the  matlx'inatical 
image  from  tlx‘  computed  image  (ilanes  to  the 
(irojectlon  sci'eens. 

The  f.ye  Iteference  Point  (f  UP)  of  the  simu- 
lated cixkidt  must  corres(iond  to  the  com()uted 
eyetioint.  'To  fix  the  KltP  with  res()ect  to  the 
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si'iffn.s  would  havi’  ro<juirv(l  the  'heroi  ns  and 
pro|i'i  tc'i>  to  In'  lixi-tl  to  a nioviiin  t)latforni.  I’hf 
l <d  i>ro|<‘i  tion  transform  (irovidod  ati  alU'i  iial ivi' 
soUiltou  bv  idliminj;  a ilyiiamii-  ixslcfinition  of  tho 
imano  |)lam‘  position  with  rosimc  t to  tho  fve|)oint 
that  trai-ks  the  1 HP  motion  w ith  r<>spoot  to  fixisl 
srronns. 

An  addl'd  simplification  of  this  sysU'm  was 
inherent  in  that  the  color  television  projectors 
useil  (I  IK  nnxlel  P.laOOd)  were  desit;ne<l  for  fltif- 
screen  (iroiection.  Since  the  linearity  in  these 
(iroiectors  is  riui'Hy  controlled  to  o()timi/.e  color 
seiiaration,  the  distortion  in  thi'  [)rojectod  imauc 
is  liAv  . 

I'he  two  types  ol  distortion  present  were  |)in- 
cushion  (due  to  slittht  lens  distortion)  and  small 
raster  drifts  in  position  and  size.  Since  the  piti- 
cushion  was  near  one  percent,  a slitiht  horizontal 
mismatch  was  evident  over  one  to  two  picture  ele- 
ments on  each  side  of  the  seam,  \crtical  size  was 
adiusted  to  brint;  vertical  mismatch  to  w ithin  one 
line.  Horizontal  size  was  adjasted  to  minimize  the 
horizontal  mismatch  at  a bxation  five  dettrees  to 
ten  deurees  alxive  an<l  lie'low  the  horizon. 

rhe  ilriits  in  size  and  position  were  stabi- 
lized by  an  edne  mtdeh  control  systi'in,  I'iKure  f. 

This  control  system  uscil  (iholo-rcsistive  detectors 
pbiced  at  the  i-dne  of  thr-  screen  in  the  horizontal 
overlap  ai  ca  to  sense  vidr'o  cursors.  I'hese  cur- 
sors were  a*lded  to  the  vi<lc(»  by  the  ('til  outside  the 
com|iutcd  imaitc  area  ol  the  raster.  The  control 
electronics  alMebraicallv  added  the  error  signals 
to  obtain  both  size  and  position  control  sinnals  in 
the  Vertical  and  horizontal.  These  signals  were 
UM'd  to  chanpe  thr-  sweep  voltat;e.s  anti  position 
biases  in  th»' projectors  to  achieve  j;eomctrically 
stable  o|>eration. 

.\n  examiile  ol  the  use  of  a polyhedial  array 
of  imajte  planr  s having  a larjti'r  numix'r  of  facets 
IS  tlx'  .-XSI’T  system.  In  this  casi',  theotitical  sys- 
tem which  condtines  the  imanes,  is  an  In-l.ine 
Infinity  ( ijitit  al  System  (ll.l<>S)  arruy,  f igure  a. 
since  the  ll.ltis  tiansforms  its  focal  surface  to 
infinity,  it  is  necessary  to  transform  tlw  imane 
plane  to  tla-  II.IOS  lix  al  surface  ainl  still  jircserve 
the  correct  angles.  To  visualize  this,  assume  that 
the  ( lil  imaitc  jilanes  are  ma|)|K‘d  to  infinity  such 
that  all  angles  subU'ndeit  al  the  eye|)oint  ari’  pri'- 
served.  Tlw  II. must  perform  the  same  mup- 
pinj;  function.  It  the  imajte  is  assumed  to  Ix'  Inltt- 
allv  at  Inftnftv,  ft  can  be  majipeil  throuKh  the  II.IOS 
to  tlx-  fixal  surface.  Sinee  the  [danc  Ix'arnsiilitter 
images  tlx-  f<x-al  surface  ol  the  II.IOS  to  a splx-re 
concentrii-  with  and  one-half  the  radius  of  tlx-  II.IOS 
H|iherlcal  Ix'amsjilltter , tlw  ma|>pUij;  to  this  fixtal 


surface  is  used  to  calculate;  the  transformation. 
Keferrinjt  to  Figure  <i,  the  majipinj;  of  the  imat'c 
plane  at  infinity  to  the  focal  surface  can  lx  repre- 
sented by  a tanjjent  imajte  plane  at  the  ftxal  surface 
with  the  irnanes  mapped  to  the  surfact;  through  the 
center  of  curvature. 

In  AS1>'T,  tile  CH  T |)ho.sphor  surface  radius 
of  curvature  is  the  same  as  the  II.KxS  fixal  sur- 
face. rhi'  scan  lines  and  columns  of  picture 
elements  are,  therefore,  mapped  as  threat  circles 
on  the  (Hf'r  surface.  lAvo  choices  were  available 
to  accomplish  thi.s  transformation;  correct  the 
.sweep  to  follow  the  correct  .scan  line  and  picture 
element  positions,  or  use  a spherical  rear  pro- 
jection screen  with  a video  jirojector  whose  lens 
arc  located  at  the  center  of  curvature.  liolh  ap- 
jiroaclxts  presented  risks,  however,  the  risk  of 
extendinj;  CUT  technolojjy  appeared  lower. 

In  the  ASP'T  system  the  versatility  of  ('(11 
aj;ain  txcame  obvious.  In  order  to  maximize  res- 
olution, the  raster  was  alijcned  parallel  to  one  edne 
of  each  pentagonal  facet.  This  approach  most  ef- 
ficiently covered  each  facet's  field  of  view  with  the 
raster.  The  juxta|)osed  rasters,  therefore,  were 
()ut  at  different  angles  and  the  rasters  center  was 
not  coincident  with  the  pentagonal  facet  center. 

This  task  of  symmetry  caused  no  problems  of  in- 
accuracy in  the  CCd  system  since  the  only  require- 
ment was  to  correctly  define  the  image  pUme  fiehl 
of  view  for  each  facet  with  resjiect  to  the  eyepoint. 

Ailded  flexibility  in  alignments  were  allowed  by 
this  ability  to  define  the  image  planes.  The  align- 
ment of  each  individual  channel  is  performed  by- 
using  theixlolite  hxated  at  the  center  of  curvature 
to  measure  and  correct  grid  intersection  Uxations. 
It  is  a leilious  and  time-consuming  pnx'cdure.  Due 
to  anomalies  peculiar  to  each  II.KXS  facet  and  ('H  I'/ 
electronics  channel,  the  alignment  is  neither  (ler- 
feet  nor  optimized  to  any  jiarticular  viewing  lixa- 
tion.  .An  alignment  algorithm  has  Ix'en  devised 
which  redefines  the  image  planes  to  ojitimize  the 
overall  alignment.  Injiut  data  is  a set  of  error 
measurements  recorded  for  selected  grid  inter- 
.seetions  in  each  chaimel.  .After  alignment,  the 
stability  Ls  maintained  by  low-drift  electronics  and 
the  rigid  structure  which  holds  the  t’H  T's  and 
ojitics.  PcriiHlic  maintenance  is  required  to  per- 
form realignment  but  it  is  infrequent  since  the 
stability  requirements  were  considered  in  the 
initial  design  of  the  t’H T/ Fleet ronics. 

The  next  two  examples  of  juxtajiosition  are 
represented  by  tlx  Itix'ing  and  MHC’.-\  visual  sys- 
tems, Figures  7 and  s.  The  displays  in  tlx-se 
systems  use  a 2(i-tnch  high  resolution  shadow 
mask  ('ITT.  Tlx  images  from  two  or  three  t'H'T's 
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Figure  6.  Mapping  of  image  PJane  to  ILIOS  Focal  Surface 


Fiirurp  MUCA  V'lsual  System 


arc  comliiMcil  t)V  m(«liticil  t.')-i|iM;rec  ljeams()littiT ' 
spherical  mirror  optics.  I'iie  Cltr's  arc  con- 
structed Irom  fiuincl  and  lacc  plate  elements  used 
It)  commerciiil  tul)es  to  ndidmi/e  cost.  I'or  this 
reason  the  Clir  phosphor  surface  d<H‘s  not  tie  in 
the  o|)tics  system  fix  ul  surface  and  the  hx'ation  of 
the  Clt  r and  hK-at  surface  imanes  are  shown  as 
transformed  hy  the  plain'  U'amsplitter  (see  I'i^- 
ure  !t).  11  tlu'  t'ye|)oint  is  liK'aU’d  at  the  center  of 

curvature  ol  the  spherical  mirror,  the  correct 
imavte  liH'ation  on  the  (’It  T surface  is  the  projection 
line  throuKh  the  eyepoint  to  tlw  tannent  imane  plane 
similar  to  ttK-  ASl’l  inaopiii).;.  In  order  to  in- 
crease the  instantaneous  fiehl  of  vievt,  the  1 Itl’  is 
located  closi-r  to  the  mirroi'  than  the  center  of 
curvature.  WK-ationol  correct  imaue  jiolnts  was 
di-tei  mined  hy  computer  programs,  and  the  CH  I'/ 
electronics  vveie  designed  to  achieve  this  mappinj;. 
Accuracy  and  stahility  re(|uirenicnts  of  the  sweeps 
were  nearly  the  same  as  the  \Sl’l  system  in 
ordiT  to  achieve  aecejitahle  ju.xtapos ition  accuracy 
of  imaites. 

f rom  the  precedinu  etiorts,  it  was  appaieiit 
that  exti'iisions  of  the  visual  simulation  technoloKy 
into  wide  field  ol  view,  I'olor  presentations  with 
aeceptahle  resolution  and  hriuhtness  would  re<iutre 
lai'Ke  »-X(M'nditures  for  liiph  rish  ilevelojimen* 


I'lforls  or  a uni(|ue  approach,  (ini'  approach  which 
was  inveslinatcd  is  shown  in  Fiiture  lu. 

\ ideo  projectors  form  an  iniaue  on  a juxta- 
posed array  of  field  lenses.  \ wl  le-anule  len.i  at 
the  center  of  the  array  relays  the  iniaue  to  another 
w ide-anitle  lens  lix'ated  at  the  lop  foi-us  ol  a double 
ellijisoid  consislini;  ol  a mirror  and  screen.  .Xn 
imaue  is  formed  In  tween  the  output  lens  and  mir- 
ror such  that  the  mirror  proiccts  the  iniaue  to  the 
screen.  Since  the  mirror  and  screen  share  acom- 
mon  fix'Us  point  and  have  the  same  I'lliplicity , Ihi 
pilot  located  at  the  hotloin  loi'al  (loiiit  of  the  screen 
is  presented  an  iiiiajje  with  iiiininiuni  distortion. 
From  lirst  order  aiKilysis,  the  chief  ra\  s in  this 
system  will  Ix'  hwateil  at  anules  corres|iondiiii;  to 
the  initial  calculated  positions. 

A full  scale  prototype  of  this  system  w :is  huilt 
which  eonfiriiicd  the  nia|i|)ini;  (see  Fijture  11).  I'he 
lirolotype  consisted  of  availahle  lens,  video  (iro- 
leclors  and  a custoiiHiuill  screen.  peak-si  reen 
uain  of  nine  was  achieved  with  uoixl  uniformity  and 
no  dislraclinn  surface  hlemishes.  (in  axis  entraiui' 
pujiil  chips  a function  of  field  anule  was  not  accom- 
mixlated  hy  the  availahle  field  lens.  This  caused  a 
per  channel  hriuhtness  f:ill-off  whii'h  was  distrtiet- 
inu.  I.ater;il  chromatic  alx'i  ratioii  ami  astiuimilism 
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Kiliuro  11. 

in  the  w nli'-nnuli'  lcn.'^i  > liniitcil  ncicptalili-  pci  - 
toi  inancf  to  tlio  lonMinl  lii'lil  of  view. 

An  altci  naU'  tiailcolf  in  llii.s  typo  of  systctn 
1...  to  componf.aU'  lor  ilistortion  on  the  sfrocn  ami 
ifiiuic  the  nutnlHT  of  optical  elements  nspiireil  in 
the  sysU'in.  Since  the  raster  of  a sinule  i,'un  color 
lijiht  valve  cannot  lie  shaped,  it  is  necesstiry  to 
achieve  mappinj;  in  other  parts  of  thi’  system,  l or 
example,  a camera  model  system  allows  the  raster 
shaping  in  the  camera.  Analonously  th<‘  ('(d  sys- 
tem should  allow  shapinn  in  the  imane  plane. 

This  corici‘pt  leads  to  the  discussion  of  tlx* 
•WV.AVS  system  Iti  which  this  flexihility  of  the  ('(il 
will  Ih'  Improved  and  imi>lemetited.  This  iniple- 
mimtation  of  tlie  {’(ll  majipinit  mipahility  will  make 
tlx-  .AWAVS  .system  tlx’  forerunners  in  ( ill,  dome 
teclmolotcy. 


lA  I ION  W ll>l-A.NIil.l.  \ IM;A  I SVS  TKM 
(A  WAX'S) 

The  Avialion  idi-Anule  Visual  Syslion  is  a 
lomplex  camera  model,  ( (il  dome  visual  system 
liiilll  ti\  Sinner- 1. ink  and  (ameral  l.lectiic  isi-e 
I inure  Ik'). 


Display  Hreadlmard 

• kmeral  Idecl  ric conirihution  to  the  sv  'lem 
is  the  coni|iuti'r  imane  neaeratoi  and  the  linht  pro- 
jectors. rhi.v  pin  t of  the  \ isu;il  s\.-tem  is  signifi- 
cant hv  the  fact  that  this  is  thi'  first  dome,  i .f 
lipht  vtdvc  prolectoi  system  where  tlu'  CKi  will 
ni'iiertite  partial  noqipinn  cortcctions  from  tlu‘ 
iman<‘  plane  to  the  pilot.  I'he  lealure,  in  tarn, 
will  allow  fuluri'  doim-,  ('(il,  (if  linhl  \alve  pro- 
tector systems  to  Ik'  used  in  lioth  color  and 
mi  iniH-h  rome . 

K I rritl.  VISL'A  I ._1H^’  1 
SV.sri  M Ul  tjnUliMKN  I'S 

Due  to  the  deimind  and  requirements  of  train- 
inn  ill  visual  simulation  tmlay,  Itu're  is  an  e\er- 
lastinn  need  to  iirmluce  sophisticated  simulators. 
Itut  the  (piestion  is.'AVliat  is  the  o|itin..im  lisutil 
simulatoi  ?'■  (It  course  this  iiuestion  is  lolliMcd  li> 
two  more  very  ra|iid  ((uestions.  'AVhat  is  the  tiaiiii- 
inn  requiri-ment  and  how  much  will  the  svslcm 
cost 

In  the  disiilay  area  aloiu'  the  riKpiircments 
lor  aircraft  and  tanks  seem  to  the  same  old 
parameti'i  s that  have  lieen  planuinn  visual  sysU'ins 
lor  yi'ars;  color,  resolution,  lirinlitnoss,  field  of 
view,  eye  (lupil,  infinity  imano  of  ic:ir  imane. 
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Ki^;ure  12.  Siniplifii-d  Di.splay  C’<>I  Hl(X’k  Diat^rani 


rho  above  parameters  themselves  share  a 
wide  variation  ol  contention  within  the  u.sers. 

If  the  user  must  have  a lai'Ke  Continuous  field 
ol  view  lor  noo<l  trainaliility,  he  has  two  prevalent 
display  choice.s  tixlay;  a dodeeahedro  with  penta- 
gonal window .s  or  a dome  system  with  multiple  pro- 
jectors. Itoth  sysU-ms  lack  what  the  user  would 
ultimaUdy  want  in  jierformanee.  Itut  if  his  jxx’ket- 
IxKjk  could  afford  it,  and  his  schedule  were  lonjt 
enough  substantial  imjirovements  could  lx-  maile. 
Consequently,  the  disjilay  jiarameters  mentioned 
require  more  research  and  develojiment  to  achieve 
the  requirements  of  future  visual  systems. 

In  the  imane  nenerator  area  some  of  the  im- 
j)ro\ements  in  jiarameters  such  as  itotentlally  vis- 
ible edjtes,  variable  size  jioint  liuhts,  numtx-r  of 
edjte  crossinns  jier  scan  line,  numix-r  of  raster 
lines,  and  numIx-r  of  disjilay  channel  drives  jier 
comj)uU-r  imane  nenerator  neeil  to  lx  exjianded  by 
time  sharinn  or  other  techniques  that  will  keej)  the 
economics  reasonable. 


With  continued  imjirovements  in  the  disjilay 
and  imane  nenerator  areas,  visual  simulation  will 
exjiaml,  thus  nivinn  nreat  savinns  in  manjiower, 
monc'y,  material,  and  in  particular,  fuel. 
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‘■(S'.  I'HJLU’  S’.  'lAS’S’  a Ccniui  (otg  Lugoicel  iC<th  Glcand 

Stji(cr\i  Ociii’tal  Licctnc  Ccmfxnuj.  He  <i  piaerM'ij 

KVrko’.g  I'l;  ceiicepfuen'  deagn  t.ivaiKed  Sgiternt.  Seme 

ef  fiiese  dte.ii  .JTC-‘  Veveici.rrenf  a U'<de-A>igh'  l'<.iuei£  Syif.em, 
fhe  hue  Cieie  hitet^icf<ee  Simuieitei  the  (.(6043  Taiifc,  the  fightei 
Attack  and  the  Advanced  Tacticae'  A<  t Cembat  S<mu('at.'"t. 

i'll  ^iii'  i-KZit,  he  ma>;aged  and  detected  eatge  eeiuai'  igitemi  <n  both 
the  hatiLeate  anti  ie^tiMte  ateai.  I/u-  tijpei  of  eeiuat  ii/item 
enciude  the  fiei'bciceng:  cai(<gtaph<c , ca/teta  mi'det,  cemputet  <mage 
nenetati't , i<im  enput  iuiterti,  ignthetec  textain  input  iuiterni, 
and  Ctimeta  gunbek  iifitemi.  mc  hai  been  ditectt'i/  inveived  Mth 
the  ly  i'<juat  igittem:  Simutatet  t,et  A<t-te-A  t Cembat, 

AJ-i7  Semuiatet , 2B51  HeXiceptet  Sunuiatet,  CB33  Heuccptet 
Simuiatet , 2B3S  Hei  icoptex  Simutatet , Aaaticn  Wide  - Angie  S<m- 
iatex,  and  the  Bhuttie  '•(■(i.ia’i:  I'XiOt  tt'  tha,  he 

icexked  dixectiu  tCeth  Cemputex  Gene,tated  /"Uiji’  Vapiai/  Sijiterj,. 

VuXing  the  ceuXie  ef,  hii>  cateeX,  Hx.  '(a’:’;  hat,  heid  pt'iiticm  n: 
deiign  ateai  and  keg  management  ateai.  He  a a gtaduate  I iectXicai 
Ingeneet  ^tem  Btidgepott  LtigeneeXing  Imtitute , and  hai  taken 
gtaduate  ceuxiei  ftK.'m  the  State  Univetn  tij  c(  Men'  Vetk  en  Cemputex 
Baence  and  Bunneii  Ailminntxaticn.  '.(1.  '.(ail  hai  peniieng  patent 
appticaticni  on  a yc’n't’pcfton  Ainpt' < |( < i' i Technique  atui  a Cempute' 

Ai  ignment  Technique  u'ith  tWe  medei  beaxdi  iti<ng  epticai  pxebei. 


(iC.  LASS’V  U,'.  SH/UltR  ii  a S(ana ji  t Buitemi  [n.gineeting  at  Genetai 
liectxic  Ccmi.tantj.  He  mm  xe.ipcn.nbi e ict  the  '(RCA  luxtapcned 
diipiaij  deagn,  and  mm  the  iead  dapiau  engineex  jai  the  deagn 
and  (ntexgtaticn  Cf!  CRT-cptia  iubaaembi  ( ei  the  <n{t<nitii  cptiCi 
tiiif.Xaij  uiindcuii  on  the  Boctng  Btjitem  and  ict  ti.e  teat-'.tt'iecticn 
itght  vaive  cen^iguxatien  and  ifi-i  the  Macu’i  2B3i  n/item.  He  hai 
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SUMMARY 

Diijitdl  im.iQi'  iji'ncration  syslrins  can  oroviili'  most 
ol  till’  visual  infornialion  npcilnif  in  (icrforminq  anil  loam 
■ ng  (light  tasks  This  (ia(ief  disrussos  a inothodologv  aigili 
cahio  to'  tho  solertion  o(  visual  mfoimation  lor  DIG  itgiro 
sontation  Tho  niothoilologv  is  (lesigno'l  to  produco  sconos 
.vhich  o()timi/o  loarning  throui;h  various  stages  and  corn 
(ik'sitios,  hy  idontdying  minimal  cues  (or  each  task,  suh 
task  and  trainoo  lovol  Added  capati'litios  of  DIG  systems 
nrlude  enhancement  of  the  (terfcrmance  feedback  cues 
normally  available  in  the  real  world  task,  and  facilitation 
of  learning  by  the  provision  of  synttietic  fi'erlback  where 
d IS  normally  ileficient  in  the  real  world 

INTRODUCTION 

Complex  operator  skills  <ire  develoiied  in  stages, 
each  rldfering  from  the  otfiers  in  degree  of  coi)nitive,  (ii'r 
ceptual,  and  motor  involvement,  in  their  general  utility  In 
the  overall  system  environment,  and  in  ,he  kinils  of  de 
mands  they  make  on  the  training  situation  Fitts  (II  des 
C'lberl  three  distinct  (ihases  In  skill  accjuisition  In  the  cog 
nitive  phav,  the  intell(>ctual  .istii^cts  of  the  skill  are  learn 
ed  In  ifie  fixation  phase,  patterns  of  motor  action  are 
refined  ami  fixated  with  resiii'ct  to  uni()ue  iiatterns  of 
stimuli  In  tlie  final  stage  ol  learning,  motor  actions  are 
automated,  to  the  extent  that  they  can  be  carried  on 
Without  conscious  awareness  or  intervention 

During  tfie  cognitive  staife,  irigiortanr  elements  of 
many  visually  orienterl  tasks  are  learned  throuijh  the  asso 
ciation  of  sirecific  actions  anil  (lerformances  with  retire 
vmtations,  either  vr-rtial  or  grajihic,  of  the  visual  cues  des 
cribing  the  course  of  tfie  action  Motor  skills  are  learned 
through  iiractice  in  the  us'-  of  tfie  system  controls,  or  sIm 
ula'eif  controls,  m such  a way  as  to  cause  tfie  cue  disirlay 
(re.tl  or  Simulaterll  to  iierform  the  functions  defined  in 
tfie  cogm'ive  sta()e  As  Greiiory  (2)  has  noted,  skills  are 
knowledge  bas<*il  nredictive  behaviors  in  which  the  func 
tion  of  stimuli,  or  cues,  is  to  define  the  actions  retiuired 
in  a given  situation  Practice  ami  learning  product  iierform 
ance  whicfi  tiecomes  increasingly  like  the  standard  defioerl 
for  tfie  iirtKerlure,  task,  or  maneuver  When  tfie  stimuli 
that  cue  a siiecific  behavior  are  perceived  as  similar  to 
those  encountered  in  the  o|ierational  setting,  skrJis  (level 
ojied  in  Iiractice  become  transferable  to  that  selling 

Stimuli  viewed  directly  in  the  real  world  system  eri 
vironment  are  vital  in  the  iierformance  and  training  of 
many  vehicle  and  system  oiierator  skills  Many  high  tier 
(orrnance  military  vehicles  must  be  controlled  totally 


fhrou'ih  the  Intertiretation  of  real  world  visual  cues  in 
much  of  their  oiierational  enveloiie  In  these  systems, 
the  fixation  of  motor  skills  in  relation  to  visual  informa 
tiori  IS  crucial  in  the  development  of  effective  skill  levels. 
Traditionally,  the  fixation  of  visual  rnotor  skills  has  oc 
curred  in  real  world  selbn<)S  in  vehicles  configured  for 
training  anil  refined  and  automated  in  training  exercises 
conducted  in  (sometimes  severely)  limited  training  set 
tin()s. 

Early  develo|iments  in  simulation  technology  tier 
mitted  the  substitution  of  safe,  economical  and  conven 
lent  settinijs  for  real  world  training  at  significant  savings. 
Advances  in  the  technology  made  iiossilile  further  in 
creastrs  in  training  efficiency  and  cost  effectiveness,  but 
primarily  in  tasks  in  which  visual  cues  were  either  lacking 
or  of  minimal  significance  As  recently  as  1977,  Caro  (3) 
was  able  to  say,  with  some  justification,  that  no  research 
had  conclusively  demonstrated  the  training  value  of  visual 
simulation.  Visual  simulation  systems  clearly  demonstrat 
ing  iiositiye  training  value  have  only  very  recenti  / come  in 
to  being.  Wheal  (4)  extiressed  the  oiiinion  in  1976,  after 
surveying  a number  of  simulator  prolilems,  that  "curren* 
visual  disiilays  are  rougbiy  a generation  behind  tfie  rest  of 
simulator  technology." 

An  obvious  reason  for  the  relative  neglect  of  visually 
cued  ofierator  skills  is  the  inability  of  any  simulator  visual 
disiilay  medium  to  iiroduce  visual  scenes  eiiuailing  or  even 
a|i|iroximating  the  complexits  of  any  but  *he  simtiiest  real 
world  scenes  available  to  system  operators  But  a more  im 
(lortant  reason  is  the  failure  of  system  designers  and  users 
to  identify  the  real  world  scene  elements  and  scene  dyna 
rnics  repuired  for  effective  training  This  stems  to  some  ex 
tent  from  the  assumiition  that  transfer  of  traininr)  deiiends 
on  the  deiiree  of  obiective  similarity  lietween  the  training 
and  ofierational  environments,  when  in  all  iirobability  the 
similarity  need  only  be  subiectively  [lerceived  for  effective 
transfer  In  addition,  of  course,  it  is  aiitiarent  that  comiilex 
skills  develofi  not  only  in  gualilalively  unigue  stagt's  but  in 
meaningfully  delinable,  discrete  comiionents  These  dis 
Crete  congionents  can  frequently  be  associated  with  much 
simpler  visual  information  than  is  ordinarily  seen  in  the 
operational  setting.  In  effect,  the  dynamics  and  configura 
tion  of  these  simple  cues  can  be  abstracted  from  the  real 
world  scene,  to  simfilify  and  systemali/e  training. 

Caro  (4)  cites  the  research  of  Flexman,  Matheny, 
and  Brown,  who  taught  contact  landings  in  the  T 6 aircraft 
by  manually  tilting  a simple  blackboard  representation  of  a 
runway  lra|le^old,  mounted  in  front  of  an  SNJ  OFT.  Caro 
also  cites  extteriments  in  which  (lurely  instrument  training. 
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(-DndiKti'd  in  ,i  sitTujI.ttof . rcdiii'cd  rcciuirctiipnls  for  visual 
flii|td  tMinini)  in  tmih  tolary  and  lived  winq  aircraft  Fin 
ally.  Sniitfi  Waters,  and  Fdyyanls  (b)  were  at)le  to  reduce 
visual  fliqfil  traininq  reuiiireinents  in  the  T 37  without  uS 
inq  any  sirnuliilor  at  all.  m the  traditional  sens*!  Tlie  over 
head  traffic  (latlern  was  tauqht  witti  a comtnnahon  of  trrxt. 
soijnil  slirte  and  Bni'"  rnotion  (iicture  materials,  rpsullinq 
in  a siqnificant  s.ivinqs  in  fliqfit  time  reriuirements  Ofivi 
ously,  hiqh  fiilelity,  in  the  classic  sense,  is  not  needed  for 
efir'clive  visual  traininq 

The  Nature  of  Visual  Cues 

Visual  cues  are  chanqes  in  visual  scene  elements,  re 
sultinq  from  the  otreration  of  the  system's  controls  or  from 
chanijes  in  the  system  environment,  to  which  the  system 
o()erator  must  res()ond.  In  many  real  world  visual  scenes, 
visual  cues  are  hiqhly  redundant,  control  is  (lossitrle  tiy  at 
tendinq  to  (or  dis[)layinq)  only  a irart  of  the  normally 
available  scene,  provided  the  i>arts  of  the  visual  scene  that 
are  rrrarie  available  are  (lerceiveif  as  varying  in  the  same  way 
that  the  total  visual  scene  would  vary  under  similar  circum 
stances  In  many  flight  tasks,  as  in  other  operator  tasks.  It 
aiipears  that  up  to  a point,  visual  cues  can  tre  drastically 
afrstracterl  for  training.  A simple  checkeriroard  display 
retrresenting  the  terrain  (5)  aiipeared  to  provide  sufficient 
cues  to  altitude,  altitude  rate,  and  ground  velocity  in  a 
complex  air  comtiat  task.  In  the  same  situation,  the  pro 
lected  view  of  a scaled,  articulated  model  barely  provided 
the  rfeqree  of  detail  required  in  the  target  image  to  simu 
late  air  to  air  maneuvering  and  gun  tracking.  In  the  case  of 
tt.e  terrain  image,  cue  reriuirements  were  minimal  for  the 
ACM  task,  in  the  target  aircraft  disfrlay,  skilled  pilots 
needivt  as  much  information  as  could  tie  provided,  to  per 
form  as  they  were  alrle  to  perform  in  the  aircraft. 

Visual  Cues  and  Skill  Level 

Novice  pilots  appear  less  likely  to  be  able  to  use 
complex  control  cues,  while  skilled  pilots  seem  to  have 
learnerl  to  use  cues  not  reatfily  recogni/ed  by  the  novice. 
The  novice  perceives  little  of  the  flight  environment  until 
he  has  had  time,  experience,  ano  quittance  in  recognizing 
the  rfynamic  relationships  amtrng  control  inputs  and  spec 
ific  'mvironmental  changes.  As  he  trecomes  more  skilled 
and  more  experienced,  he  learns  to  incorporate  more  and 
more  environmental  information  in  his  perceptions. 

Ideally,  the  simulator  shoulrt  provitle  an  opportunity 
tor  the  sturlent  to  develop  these  basic  perceptions  in  un 
cluttered  settings,  until  such  time  as  he  is  able  to  deal  with 
clutter  per  and  to  learn  to  recognize  elements  of  the 
clutter  as  meaningful.  Simulator  instructors,  flight  instruc 
tors,  ant)  training  programs  have  traditionally  providerf 
ttHise  opportunities  to  a degree,  by  artapting  training  set 
tings  to  the  capabilities  of  the  sturlent  at  each  stage  in  his 
development 

In  general,  simulators  are  equipped  to  permit  the 
adaptation  of  training  to  student  capabilities  fretter  than 
airplanes,  and  some  simulator  systems,  properly  (iiogram 


med,  [lermit  arfaplation  lietter  Ifian  otliers  Visual  systems 
have  tieen  less  flexitile  in  this  resiiect  than  motion,  aural 
cue,  anil  instrument  systems  They  have  almost  always  prrj 
vided  cuing  information  defined  more  by  their  own  unique 
capabilities  and  limitations  than  tiy  the  neerfs  of  sturlents 
of  varying  levels  and  k intis  t)f  ability 

Digital  Visual  Cues 

Digital  image  generation  systems  are  unique  in  a 
number  of  ways,  but  untiueslirznably  the  most  important 
characteristic  of  ttiese  systems  is  their  flexifrildy.  Camera 
model  anti  film  systems,  while  provitling  high  quality  visual 
scenes,  cannot  Ire  reatlily  reprograrnmetl,  once  defined,  the 
applicability  of  a given  motlel  or  film  sequence  is  limited 
to  a spcHtific  training  situation  Digital  systems  can  be  pro 
grammet)  for  an  almost  infinite  number  of  levels  of  com 
plexity,  anti  in  atldition,  as  Roscoe  has  shown  (61,  they  can 
be  proqrammet)  to  provide  augmented  feedback  informa 
tion  to  enhance  botfi  training  ant)  transfer  Given  this  capa 
frility  of  digital  image  systems,  it  trecomes  necessary  to 
identify  the  cues  requiret)  at  each  level  of  skill  develop 
ment,  and  to  define  the  kintls  of  natural  and  programmed 
feedback  needet)  to  enhance  the  learning  of  each  skill  to 
each  level  requiret)  by  the  mission  being  supported 

Many  visual  simulation  systems  have  been  designed 
to  incorporate  all  of  the  visual  information  possible,  but 
sometimes  the  level  of  iletail  has  been  inconsistent  with 
the  ability  of  the  display  system  to  process  it,  and  to  make 
It  vary  realistically  with  control  inputs.  Sometimes,  impor 
tant  information  has  been  left  out  for  the  same  general 
reason:  the  medium  could  not  handle  the  storage  or  the 
display  problem,  in  some  critical  area.  Obviously,  digital 
image  systems  will  not  be  able,  for  a long  time  in  the  fu 
ture,  to  display  full  fidelity  representations  of  complex 
visual  scenes  Because  they  can  display  nothing  before  the 
scene  requirement  is  thoroughly  defined,  however,  they 
fiave  the  advantage  of  requiring  a clear  definition  of  the 
scene  requirement  before  they  are  programmed. 

The  problem  of  programming  visual  cues  is  two  fold 
First,  a clear  definitirrn  is  requirer)  of  the  information 
neederl  to  support  specific  responses  and  to  facilitate  re 
sponse  learning  Second,  enough  cues  to  each  action  must 
be  included  to  prevent  the  induction  of  illusions.  Ritchie 
has  discussed  in  a recent  paper  (7)  some  of  the  ways  in 
which  illusions  can  result  in  visual  systems  in  which  impor 
tant  cues  are  missing. 

Digital  image  systems  can  minimize  the  effects  of 
these  problems  by  programming  only  those  cues  which  ate 
essential  for  specific  levels  of  practice,  in  specific  tasks  and 
subtasks.  Digital  image  systems  thus  place  a special  respon 
sibility  on  the  visual  system  designer  for  defining  in  detail 
the  cues  ncetled  for  learning  in  each  level  of  skill  and  stu 
dent  sophistication,  and  for  precluding  the  induction  of 
illusions  through  the  deletion  of  cues  which  are  not  pri 
rnary  for  the  task,  or  which  are  incompatible  with  the 
availaltle  storage  and  display  media  Task  analysis  has  been 
a nominal  requirement  for  many  years  in  the  development 
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ot  tidinmg  system  concepts.  t)ut  little  attention  has  been 
given  to  the  identilication  ol  S|iecific  scene  element  re 
qiiitements  for  s()ecific  tasks  and  sjiecdic  learning  con 
texts  F otijre  visual  simulation  systems  will  have  to  he  de 
SigniM  to  tulfill  si>ecitic  task  renuirements,  tiased  on  task 
an.ilysis  data,  amt  they  will  have  to  permit  some  trial  and 
error  in  thr*  devrrlopment  ol  sceni's  which  are  both  res(>on 
siv  to  thi"  training  ri><)uirement  and  ei onomical 

The  problem  in  tri.il  and  error  design  is  that  it  is  not, 
111  the  long  run.  tiractical  or  economu.al.  Iwcause  it  is  al 
■nost  Iirgiossitile  to  do  within  a realistic  training  context 
In  thi  hri.i!  ariaiysis  it  will  tie  netessarv  to  rlesign  digital 
visuai  sr  eiies  as  O'l'  training  system  is  iiesuined  to  (irovirle 
11. e ^ "iis  0 visual  lues  neeiled  m e.ic'i  ,ta')e  of  tMining 
TasI'  ii'a  ,ses  tor  tra  ning  system  and  tr. lining  eumpmeni 
itesigi'  s\;l;  h.ive  to  tu'  liriallv  r*  ,(i  traininii  tas^  inalyses 

TASK  ANALYSIS 

H B Miller,  over  twenty  years  ago  dehneil  the  re 
guirernei'ts  lor  anrl  the  uses  ot  task  analysis  in  System  de 
ye  'I(iment  and  I'ain  r g SySte"  design  A though  he  de 

guiii  r.li'ai  y the  liiHereni  i s la  lyseen  task  di-si  r ptiori 

and  task  analysis  '8i  ''Mny  task  inaiysis  efliuts  iliiring  the 
inter'veninij  yiMis  have  t'eeri  limited  to  task  descrgitions, 
Id  yvliic*!  tasks  are  descrdieil  in  rlet  iil  with  less  attention 
to  task  dynamics  than  is  re(|uired  in  training  system  ilevel 
oiiment  E irgihasis  is  reguired  now  on  the  analysis  ol  the 
behavorai  astiects  of  tasks  and  ol  the  learning  functions 
involved  in  optimi/ing  the  rlevelo()ment  and  maintenance 
of  taSA  [irolicieiicy  This  is  necrtssary  in  all  simulation  at) 
plications,  but  esiiecially  in  visual  system  design 

Flight  tasks  ace  ty|)ically  ddficult  to  analyze,  be 
caute  the  source  of  data  is  so  frequently  skilled  |)ilots 
whose  skills  are  essentially  nonverfial  More  attention 
must  tie  given  to  the  fundamental  dynamics  of  the  tasks 
and  the  task  learning  iircxiesses  to  which  the  simulator  is 
to  tie  a|)t)lied  The  analysis  of  tasks  for  visual  system  de 
sign  can  tie  approactied  in  many  ways,  but  consideration 
of  the  following  poirts  can  facilitate  the  systematic  (level 
oiiment  ol  visual  system  design  concepts 

1)  Available  Cues  The  simulator  cannot,  within 
the  technology  availatile  now  or  in  the  near  future,  pro 
V de  all  of  tfie  visual  in'ormation  available  in  many  flirjht 
rei, vines  Na()  of  the  earth  flight,  terrain  avoidance,  air  to 
ground,  air  to  air,  and  even  hovering  maneuvers  involve 
more  infoimalion  loan  can  tie  represented  in  a simulator. 
Thev-i  riianeuvers  and  others,  however,  must  be  analyzed 
for  their  visual  information  content,  so  that  the  analyst 
and  ttie  designer  can  begin  to  visualize  ttie  task  perform 
ance  (irolilem.  and  the  learning  iirolilem  Some  cues  can  lie 
stored  photogratihically  for  analysis  tiy  expert  (iilots, 
instructors,  students  and  training  analysts  Figure  1 is  an 
example  of  a scene  having  training  implications,  and  impli 
cations  for  visual  system  design  AIttiougti  it  is  not  in 
color,  It  does  [irovide  some  insi()ht  into  the  corniilexity  and 
information  content  available  in  a relatively  simtile  flight 
situation 


Figure  I.  Normal  ’/F'fi  Landing  Scene 

2)  Task  Functiojis.  Since  the  student  using  the 
simuldteil  visual  system  must  learn  certain  dynamic  rela 
tionships  amon()  tfie  tiefiavior  rjf  tfie  visual  environment 
and  the  irgiuts  made  on  his  controls,  it  is  necessary  to 
establish  the  functions  whicti  he  is  expected  to  perform 
within  ttie  tasks  unifer  consKferation.  Identifying  specific 
task  functions  can  tielp  m the  identification  of  the  cues 
associated  with  the  functions  and  can  help  in  defining 
those  which  are,  in  fact,  minimal  or  essential  cues  Since 
skilled  pilots  tenrl  to  have  difficulty  in  noting  or  recalling 
their  responses  to  visual  cues,  it  is  useful  to  review  many 
tasks  with  instructor  pilots,  and  also  with  students,  where 
possitile  Instructor  pilots,  in  general,  consciously  attempt 
to  identify  the  cues  to  which  the  student  should  respond, 
so  that  they  can  be  identifie'f  by  the  student  in  the  con 
text  of  real  world  clutter  Also,  exiierienced  pilots  fre 
quently  can  recall  circumstances  in  which  many  scene  ele 
ments  were  missing  (flying  ever  the  desert,  in  limited  visi 
bility,  over  fields  of  hay,  over  water)  and  whicfi  provided 
either  inadequate  or  contusing  cues  The  recall  of  such  ex 
periences  can  be  especially  useful  in  establishing  the  rela 
tionships  among  siiecific  task  functions  and  the  visual  in 
formation  available  in  the  (lerformance  ol  the  function. 
By  the  same  token,  students  at  various  stages  of  learning 
can  fre()uently  recall  their  reactions  to  visual  scenes,  and 
the  scene  elements  they  learned  to  res()ond  to 

While  many  flight  tasks  are  complex,  and  require 
higtily  developed  (lerceiitions  and  iierceptual  motor  skills, 
most  involve  some  combination  of  functions  with  which 
discrete  visual  cue  requirements  can  be  associated.  The 
pilot  in  almost  all  flight  control  situations  must  eventually 
learn  to  control  attitude,  spatial  iiosition,  geographic  posi 
tion,  ground  velocity,  flight  path,  altitude  rate,  closure 
rale,  and  fligfit  (latfi  with  resiiect  to  otislacles  along  the 
route  Individually,  the  essential  cues  to  each  ol  tliese 
functions  are  relatively  simple  In  Figure  1,  some  of  ttie 
more  obvious  cues  to  fliight  control  in  lai  ding  can  be  iden 
tilled  Some  are  redundant  tint,  because  of  the  size  ol  the 
picture,  Itie  lack  ol  color,  antf  the  laci  that  it  is  static, 
many  useful  cues  are  missing.  Figure  2 is  an  artist's 
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. oiKf-'i  t ol  iK'thai'S  the  simi  liv;t  digital  im.igi' 
seen*'  tliat  could  be  used  i ti  tr<iiiiing  of 

the  lajidmg  task.  Gross  cues  ta-edecl  in  the 
control  ol  pitch  and  roll  and  (josition  on  th<' 


Figure  2.  Landing  Scene  with  Minimal  Visual 
Scene  Content 

glideslope  and  centerline,  and  some  of  the  cues  to  altitude 
and  closure  rate,  are  available  in  the  geometry  of  the  scene 
and  in  changes  in  the  si/e  of  the  simple  runway  image 
The  cues  disiilayeti  m this  iiicture,  and  those  whicti  would 
be  available  in  a dynamic  scene,  are  adequate  for  teaching 
some  comjionents  of  the  landing  maneuver,  under  ideal 
circumstances.  Figure  3 shows  more  cues  to  position,  do 
sure,  and  flight  (latfi,  and  introduces  additional  cues  based 
on  the  afisolute  si/e  of  some  elements  viewed  by  the  stu 
dent  in  the  real  world  Taxiways,  buildings,  and  runway 


Figure  1.  Landing  Some  with  Added  C>>ome- 
trii  and  Textural  Cui'S 

markinijs  add  cues  wfiich  are  probafily  redundant  with  the 
Simple  geometric  cues,  tiul  winch  require  less  interjireta 
tion  In  addition,  more  cues  to  position  are  providrxl  by 


tfie  relative  motion  of  scene  elements,  permitting  the  per 
ceplion  and  learning  of  more  cues  than  was  iiossible  in 
Figure  7 Figure  4 is  a more  complex  scene,  and  while  it 
IS  probably  little  Ixitter  in  training  tbe  task  elements  that 
could  tie  trained  in  a scene  like  F igure  2,  it  provides  fietter 


Figure  •! . I^iridlng  Scene-  with  Added  Textur.il 
and  I'arallax  Cues 

position  and  closure  cues,  which  are  important  in  flight 
conditions  that  are  less  than  ideal  The  cues  provided  in 
this  scene  would  (lermit  the  learning  of  basic  flight  control 
skills  and  some  of  the  skills  required  in  landing  at  this  par 
ticular  airiiort  With  wind,  turbulence,  and  the  ..me  sharing 
required  in  dealing  with  system  failures,  these  extra  cues 
provide  a better  opiiortunity  for  the  student  to  grasp  the 
dynamics  of  the  landing  situation  In  addition,  these  extra 
scene  elements  tell  the  pilot  about  some  of  the  unique 
problems  encountered  at  this  airiiort,  where  the  apiiroach 
IS  made  over  sloping  terrain  Novice  pilots  fre()uently  take 
altitude  and  altitude  rate  cues  from  the  terrain  under  the 
approach,  flying  glidepaths  well  lielow  the  ideal  glideslope 
The  atidition  of  scene  elements  representing  trees,  roads, 
fields,  and  buildings  under  the  apiiroach  path  permits  the 
student  to  learn  the  set  of  task  elements  relating  to  visual 
scanning  and  cross  cfiecking,  not  possilile  with  a simpler 
visual  scene 

Figure  b illustrates  another  neerl  for  more  than  sim 
pie  cues  in  the  visual  scene  Since  iiilots  must  fly  in  less 
than  ideal  conditions,  they  must  have  inactice  in  dealing 
with  maiginal  conditions  Another  task  element  in  the 
landing  maneuver  is  the  use  of  minimal  and  fleeting  cues  in 
perceiving  and  controlling  the  iiosition  of  the  aircraft  The 
visibility  conditions  illustiated  in  F igure  b,  superimiiosed 
on  Figure  2,  would  almost  preclude  any  learning  at  all  The 
detail  in  Figure  4.  over  which  the  clouds  are  laid,  would 
(lermit  the  student  to  learn  to  recognise  his  (losition,  and 
to  make  realistic  ies(ionses 

Figure  6 deals  with  another  set  of  task  elements 
wtiicti  liecome  ingioitant  as  the' aircraft  moves  from  tlie 
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still  does  not  come  near  to  usinq  the  total  capacity  of  even 
a sim()le  digital  image  generation  system. 


3)  Minimum  Cues  Figures  2 through  7 portray 
scenw  related  to  one  flight  maneuver.  Figure  2 represents 
the  minimum  set  of  visual  information  requirerf  in  practic 
inq  some  elements  of  the  landing  approach  task,  under 
Ideal  flight  conditions  Figure  3 also  represents  a minimum 


Fiqur>-  5.  Visibility  Kffoctn  in  the  l,<inding 
Scene 

flight  environment  to  the  ground  Markings  on  the  runway, 
familiar  in  sfiaiie  and  si/e,  the  stones  on  the  embankment, 
and  the  motion  of  the  aiiproach  light  fixture  with  respect 
to  Its  immediate  background  provide  cues  to  lateral  and 


F»qure  6.  breakout  of  Textural  Scene  Kle- 
ment.s 

vertical  (lositions  and,  equally  important,  to  rate  of  closure 
with  the  toucfirJown  /one  This  scene  contains  a great  ileal 
of  information,  trut  much  less  than  is  contained  in  the  real 
world  view  it  refiresents  The  information  it  contains  is 
directly  relateil  to  skill  elements  identified  with  the  land 
inq  task,  anri  it  is  well  within  the  capabilities  of  reasonably 
economical  digital  image  generation  systems.  Figure  7 con 
tains  even  more  information  in  the  form  of  cues  to  altitude 
rate  Scene  elements  portraying  runway  lights,  tire  marks, 
runway  grooving,  and  patches  of  color  in  the  grassy  areas 
are,  in  a limited  sense,  textural  cues.  More  than  this,  how 
ever,  they  are  cues  to  the  precise  altitude  and  motion  of 
the  pilot's  eyetKiint  in  relation  to  readily  recogni/erf  real 
world  scene  elements  This  scene,  while  relatively  complex. 


Figure  7.  The  Visual  Scene  at  Touchdown 

set  of  cues  relevant  to  other  task  elements  relating  to  mo 
tion  parallax  and  the  breakout  of  familiar  detail  with  do 
sure.  Each  of  the  other  pictures  represents  the  minimal 
cues  which  seem  to  be  required  for  training  various  other 
task  elements.  Minimal  cues  are  important  in  minimizing 
the  cost  of  the  system,  but  they  are  even  more  important 
in  supporting  systematic  learning.  Digital  systems  can  pro 
vide  cues  of  varying  content  and  complexity  commensur 
ate  with  the  student's  ability  to  perceive  and  apply  them  in 
practice,  and  to  identify  them  as  key  elements  of  the 
real  world  visual  scene.  Minimal  cues  must  not  be  defined 
as  the  minimum  information  varying  in  the  scene  with  con 
trol  inputs,  l)ut  rather  as  the  minimum  information,  vary 
ing  with  control  inputs,  which  the  trainee  can  readily  per 
ceive.  Once  he  does  learn  to  perceive  them,  other  cues  can 
be  added,  to  provide  the  minimal  scene  content  relevant  to 
the  next  task  element  to  tie  learned. 

The  experience  and  background  of  the  student  who 
IS  to  be  trained  is  an  important  consideration.  Simple  sets 
of  cues  are  more  likely  to  be  acceptable  lor  novices  than 
for  skillerl  pilots  who  have  already  learned  to  reconcile  the 
redundant  information  contained  in  real  world  visual 
scenes  The  student  can  learn  to  recognize  simple  cues  as 
they  are  emtxjdded  in  the  real  world,  but  the  skilled  pilot 
may  have  difficulty  in  interpreting  them  out  of  context. 

4)  Part  Task  Training.  Visual  simulation  systems 
are  usually  asscxiiated  with  crew  trainers  and  mission  simu 
lators,  but  the  flexibility  of  the  digital  image  approach 
lends  Itself  esfiecially  to  part  task  training.  Digital  images 


can  provide  elemenlaiv  cues  for  initial  task  traininq,  and 
aimrnented  fp«“dliark  cues  to  facilitate  learnincj.  As  tfie 
trainee  (uoi)resses  in  Ins  qias[)  of  the  iiercetits  associatert 
iivith  indivirfual  task  elements,  arfditional  cues  can  lie  addetf 
so  that  irroqress  throuqfi  the  staqe  dest;ril)ed  by  Fitts  as  the 
fixation  staqe  can  Ire  controlled  to  match  the  nature  of  the 
task  to  the  learmnq  functit)n  hy  which  it  is  mastererl 

Since  tfie  inforniation  makinq  uti  tfirr  (iitjital  irnarje 
scene  is  stored  in  software  ratfier  ttiari  in  harilware,  it  can 
he  prorjiammed  lor  rlisplay  in  any  ainiroiiriate  manner  and 
It  can  tv  mt>riifit*rl  without  chunqinq  fiarriware,  to  otiti 
rnally  suiiiiort  the  sfiecific  traininq  situation  under  consul 
eratirrn  at  a qivrn  time 

latile  1 IS  a summary  of  the  scene  elements  makinq 
u|i  each  of  tfie  artist  s concejits  representr.'d  in  Figures  2 
through  7.  Table  1 also  lists  the  numlrer  of  edges  used  in 
makinq  up  each  element  and  each  scene  (Erlqes  are  here 
defined  in  the  way  that  is  now  usual  that  is,  as  the  edges 
of  [lolyqons  winch  face  toward  the  viewer,  whether  or  not 
ttiey  are  occulted  try  another  ol)|ect,  so  long  as  they  are 
within  the  field  of  view.  Wtiere  two  erfqes  of  an  ob|t‘Ct  lie 
togi'ther  altrnq  ttieir  full  lengths,  they  are  counted  as  only 
one  (Hlqe  I Each  picture  represents  a pilot's  front  window 
view,  anil  since  the  most  com()lex  scene  rirpuires  only 
2,380  eilq<‘s  two  siile  windows  witfi  normal  scene  contour 
could  tv  provided  by  an  8,000  edge  digital  image  genera 
tor  Tattle  2 IS  a summary  of  some  of  the  ma|or  task  func 
tions  supiiorted  tiy  eacft  class  of  scene  element. 

5)  J|lusioijs.  Ritchie  (7)  has  (lointed  out  that  illu 
sions  can  occur  in  simulator  visual  systems  when  minimal 
cues  are  iiresented  An  illusory  [lerceiition  occurs  when  a 
[lerceptual  conflict  occurs  among  sets  of  cues  to  a given 
situation  Even  when  each  set  of  cues  is  individually  cor 
reel,  the  atisence  of  cues  which  are  usually  present  can  leatl 
to  misintertiretations  of  some  scene  elements  The  percep 
tion  of  distance  in  simulator  visual  scenes  is  a frequent 
protilern  trecause  of  the  many  cues  to  distance  available  in 
the  real  world  Retinal  si/f,  motion  parallax,  perspective, 
interposition,  surface  detail,  aerial  iierspective,  and,  in 
some  limilrrr)  cases,  accommodation  and  convergence  pro 
vide  information  afiout  range,  rang*!  rate,  time  to  go,  and 
flight  patfi  There  is  some  indication  in  simulator  flying 
that  some  cues  are  more  imtrortant  than  otfiers,  and  that 
the  priority  of  cues  changes  with  the  nature  of  the  task 
and  the  maneuver  The  deletion  of  some  cues  to  distance 
can  distort  (iilot  restxrnse  to  those  remaining,  so  that  care 
must  t>e  taken  in  identifying  cues  wtiich  are  not  only  mini 
mally  essential,  but  percetitually  consistent.  This  also  must 
take  into  account  the  level  of  sophistication  of  the  stu 
dent  Unless  he  has  had  an  ojiportunity  to  exercise  control, 
or  to  make  task  relevant  |ud()ements  by  means  of  congrlex 
visual  cues,  the  deletion  of  some  cues  may  not  t)c  disturb 
irrq,  or  even  noticed  The  deletion  of  cues  will  tie  most  dis 
turfiiiKi  to  tfie  skilled  (iilot,  wtio  may  have  learnetl  to  rec 
ogrii/e  the  effects  of  his  controls  on  each  varying  scene 
element,  or  on  scene  elements  which  are  not  userl  by  other 
pilots  or  instructors  as  referents  Missing  scene  elements, 
unless  there  is  an  obvious,  task  relevant  reason  for  their 
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alisence,  inherent  in  the  condition  being  represented,  can 
proiluce  illusory  or  alinormal  resiionses  The  avoidance  of 
illusions  in  simulator  visual  scenes  will  require  analysis  and 
insiglit  with  regard  to  the  [leiceptual  and  learning  (irotilems 
associated  with  the  tasks  lieing  trained  Most  illusions  ap 
peal  to  result  from  the  inability  of  the  obsr>rver  to  recon 
cile  information  tfiat  seems  to  be  consistent  with  the  task 
with  other  information  that  seems  to  conflict  witfi  the 
task.  The  most  disturbing  illusions  are  ttios»'  in  wfiicti  the 
otiserver  is  not  consruously  aware  of  his  attention  to  the 
source  of  conflicting  information  As  a result,  great  care 
must  be  taken  in  defining  the  scene  elements  to  which  he 
miglit  Ire  trained  to  restrond,  estiecially  in  the  case  of 
scenes  fwing  designed  for  use  in  proficiency  trainers  by 
skilled  personnel. 
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Ma*ota*r'  qlu|»*  path  lo  fur^^ay  touc  fxlowri 

IHJinl 


3 4 S Ta«  -wyavs  lrf**ntif y dircraf I position  on  approach 

6 7 l>ath  ►f)  limifpfl  an<l  varying  visibility, 

ctecMle  to  Continue  or  atK)rt  approach 

3 4 S 7 BuiUJinqs  Maintain  glulppath  to  runway  touchdown 

point  correct  lor  wind  drift 


4 6 Hiiarls  Identify  aircraft  position  on  approach 

■n  limited  anrl  vanatrle  visitnhty  decide 
to  continue  or  aliort  aiuiroach 


b Grave* 


Control  glirfepath  to  runway  touchdown 
lK>int 


4 S b 7 Grass  Palc^es 
artd  Sfiadows 


Maintain  alignment  witfi  runway , con 
irol  glidepath  to  runway  touchdown 
IKjmt 


4S6  Aptiroatfi  Towei  Maintain  alignment  wth  runway 

control  glidetiath  to  runway  touchrlown 

tKjinl 


4 b Irirjividual  Clouds 


Mairitairi  alignment  with  ruriway 


6 Clouet  Cover  Hecogni/e  aircraft  position  ort  aptrroach. 

m lirmterj  arid  varying  visit)ility.  interpret 
flight  status  rtec.irle  to  continue  or  alrort 
a()proac  fi 

/ Grorwes  T ire  Mark  s Maintain  nitnirnum  sink  rate  at  touchdown 


Control  hearting  during  roHoirt  reduce 
velrxity  to  (lermit  turn  to  tatoway 


4 f>  7 Hills  Maintain  runway  aligniT>ent  during  lanrt 

mg  rollout,  rtiake  sm(M>|h  turns  from 
driveway  to  tanway 


CUE  FUNCTION 
Hon/on  roll  anrl  pitch  reference 


Ru'iway  shat»e  defines  alignment  with 
centerline,  shape  and  location  in  fieirt  of 
view  (tefirie  wind  effects 

Rate  of  change  in  shape  of  runway  and  in 
length  wirtth  ratio  rlefine  glidesio()e  angle 
and  tr>uchdf>wn  location 

Airtieirt  features  provide  cues  to  aircraft 
IfKalion  wfien  runway  'S  momentarily 
i)t)scured 

Relativr*  motion  among  scene  "lements 
provutes  cues  to  aircraft  positiofi.  glute 
path,  and  ground  track  . changes  m uuild 
■ ng  pers(>er;tive  provide  cues  to  altitude 

Scene  elements  surrouodir^g  this  airfield 
provide  cues  to  aircraft  position  when 
runway  is  momentarily  obscured  Changes 
in  relative  tiosition  of  off  airfield  scene 
elements  also  provide  information  at>out 
position,  flight  path,  and  ground  track  in 
normaf  fliqfit  operations,  fiermitfing  sfu 
dent  to  learn  to  perceive  total  situation 

Surface  (ietail  rfefines  terrain  configura 
lion  and  nature  of  terrain  surface,  relative 
motion  among  surface  elements  helps  to 
define  position  of  aircraft  on  approach 
path 

Changes  m aptiarent  shapes  and  relative 
motion  among  terrain  surface  elements 
provKfe  cues  to  aircraft  position  and  to 
location  of  touchrlown  point,  off  runway 
surface  iletails  help  student  to  learn  to 
perceive  total  situation 

Relative  motion  of  top  ot  t»)wer  gravel, 
and  runway  surface  provides  cues  to  air 
craft  position  on  approach  path,  helps 
sturlent  to  learn  to  i>erceive  total  ap 
proach  and  landing  situation 

Relative  motion  fwtween  clouds  and  other 
scene  elements  provides  cues  to  aircraft 
velocity  and  flight  path 

Visibility  effects  help  the  student  to  learn 
to  interpret  minimal  cues  as  they  ought  t>e 
availatile  m real  world  flight  oi>erations 


Gri>oves  and  individual  tire  marks  provide 
cues  to  attsulute  altitude  and  altitude  rate. 
supi)orting  practice  m ad|usting  vertical 
velocity  and  flare  heigfM  within  accet)tat>le 
limits 

T ire  otarks  and  t>lemtsties  provide  cues  to 
qrrxind  velocity  useil  m predicting  and 
controlling  effects  of  rutkler,  brakes,  re 
verse  thrust  in  slowing  to  taxi  speed,  and 
m executing  ground  turns 

Hills  and  other  distant  otgects  provide 
cues  to  heading  whose  eftectiver>ess  is 
profMtrtional  to  Ifieir  distance  from  the 
pilot's  point  of  view 
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UltinidtPlv,  ex(iprimpntdti()n  will  he  ruciiiirod  in  the 
predirlion  of  polonti.il  (irohlpins  in  tlw  indcIvHitenl  pro 
doclion  of  illosory  rpsponsos  to  siniolated  visual  scenes  In 
snitits  Cdti  tie  (|dined,  tiowever,  throoufi  the  careful  investi 
nation  of  operator  resiionses  in  a variidy  of  real  world  sit 
udtions  Most  ex)ierienced  iiilots,  for  example,  can  recall 
oiierdtirn)  with  minimal  visual  information,  or  with  differ 
ent  information  than  is  normally  availalile  Tlirrse  exfieri 
ences  are  valualile  sources  of  rlata  concerniru)  (rilot  re 
S(ionse  to  srene  elements  which  are  ordinarily  ignored,  and 
thus  not  directly  accessitile  at  tire  vertial  level  A great  ileal 
of  information  can  also  he  ofrtained  from  experience  witli 
existing  simulator  visual  systems,  ex()ecially  when  they 
do  not  retiresr-nt  some  cues  as  well  as  is  needed  Hetico() 
ter  pilots,  ftrr  example,  have  recently  exirerienced  prob 
lems  in  hovering  at  a prescritied  altitude  in  the  simulator 
The  (irotilem  seems  to  be  the  si?e  of  textural  elements  in 
the  ground  scene 
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Training  During  tfie  fixation  |)tiase  of  learning,  the  stu 
dent  needs  to  tie  atrle  to  rievelop  discrete  rcsfronses  to  rfis 
Crete  Cues,  to  the  extent  (lossitrle.  Tins  [rtiase  provides  him 
with  a repertory  of  stimulus  restronse  relationships  which, 
ultiniately,  (rermit  elementary  responses  to  be  made  to  the 
variety  of  cue  patterns  encounterird  in  training  It  also  [)er 
mits  differential  restionses  to  be  made  to  cue  (ratterns 
which  at  first  seemeri  identical.  Practice  reduces  the 
amount  of  cognition  (and  time)  reriuired  in  identifying  the 
resrirjnse  needed  at  a given  time  ant),  in  the  presence  of  a 
workload,  establishes  techniques  for  the  timesharing  and 
[ihasing  of  task  elements. 

Relevant  visual  scene  elements  are  essential  in  the 
(fevelopinent  of  an  effective  response  reirertory,  along  with 
some  way  of  fixating  correct  responses  to  these  scene  ele 
rnents  Normally,  in  both  flight  anrf  simulator  training, 
stimulus  res()onse  relationships  are  fixed  through  the  ac 
tion  of  rewards  intrinsic  to  the  task,  as  definecf  in  the  per 
formance  criteria  associated  with  it  All  training  (irograms, 
at  srarrie  time,  employ  artificial  rewards  to  facilitate  learn 
mg,  in  adifition  to  those  inherent  in  the  task  itself  DIG 
systems  are  estiecially  capable  in  this  area,  (lermitting 
visual  feedtrack  to  be  programmer)  as  apjirofmale 

Students  who  have  tial)  (lassed  through  the  fixation 
$ta<|«‘  and  who  have  already  automated  many  task  skills  can 
alsf)  (irofit  frtjrn  the  flexibility  of  digital  image  i)eneration 
systems  The  skilled  pilot's  learning  task  bears  one  im()or 
tant  suriirising  similarity  to  that  of  the  novice  he  too  must 
learn  to  recogni/e  differences  among  similar  [latterns  of 
stimuli  so  that  fie  can  prerficl  anrf  execute  res()onses  afrpro 
(iriate  it)  Itiese  rfifferences  The  DIG'S  capafiility  is  still 
limileif  in  prt>viifing  visual  cues  to  the  sutille  differences  in 
terrain,  vegetation,  anrf  tarriet  images  re()uired  in  com 
(ilelely  skilled  t)|)eralions.  tiul  it  can  (lorlray  relatively  dis 
linci  differences  among  similar  conditions  within  mission 
like  task  ctrntexts  These  com()lex  task  environments  can 
provide  skiller)  pilots  with  o()portunities  not  otfierwise 
available  lor  the  refinement  of  task  restionse  dynamics 


The  ed()e  caiialiility  of  most  DIG  systems  alst)  (lermits  the 
incoriioration  of  enough  visual  cues  to  simulate  realistic 
pilot  workloads  to  sui>i>on  irraclice  in  time  sharing  and  in 
till'  division  of  aflenlitrn  frequently  ret|uired  in  ojierational 
flight  systems. 

Artificial  feedback  may  also  be  important  in  facili 
tating  tfie  refinement  of  skilled  [lerformances,  but  very 
little  information  is  available  to  indicate  tfie  most  relevant 
types  of  feedtiack,  or  the  most  effective  feedback  algor 
ithms  a))propriate  to  proficiency  maintenance,  DIG  system 
flexitiildy  will  (leimit  experimentation  in  the  enhancement 
of  learning  and  performance  improvements  in  proficiency 
training  as  well  as  in  the  training  of  novices.  In  both  ex 
tremrrs  of  the  training  continuum,  digital  image  i|eneration 
systems  can  entiance  tfie  training  value  of  simulators  by 
requiring  the  definition  of  scene  content  and  visual  scene 
(fynamics  in  terms  of  learning  functions  rather  than 
realism. 

7)  Data  Base  Design  for  Training.  By  far  the  most 
important  consideration  in  the  design  of  visual  cuing  sys 
terns  IS  the  systematic  development  of  scenes  and  scene 
elements  relevant  to  the  specific  learning  task  at  hand 
Tasks  to  be  learned  almost  always  consist  of  multiple  task 
elements,  and  most  learning  functirjns  change  with  learn 
ing.  Eacti  of  these  facts  makes  unique  and  Sfiecdic  de 
mands  on  the  content  and  arrangement  of  the  stimuli  [iro 
vided  for  training.  We  would  suggest,  then,  the  following 
sequence  of  activities  for  the  design  of  digital  image  data 
liases  for  training 

First,  a strt  of  scene  elements,  tasks,  and  functions 
similar  to  those  shown  in  Table  2 shoultf  be  compiled  by 
(isychologists  who  have  studied  the  problem. 

Second,  a learn  consisting  of  an  artist  and  an  engi 
neer  intimately  familiar  with  the  caiiabilities  and  limita 
tion  of  the  digital  image  generator  should  work  together  to 
create  renderings  similar  to  those  of  Figures  4 through  7, 
for  instance,  tabulating  the  edges  used  and  their  percent 
age  as  in  Table  1 We  have  found  ttiat  after  some  exper 
lence  in  this,  the  artist  will  be  able  to  come  very  close  to 
what  the  fisychologist  and  the  engineer  are  willing  to 
accept  from  their  resiiective  viewpoints,  on  the  very  first 
attempt. 

Third,  the  renderings  and  the  tables  should  be  made 
available  to  the  data  base  design  group,  which  shoulil 
contain  people  who  can  rlraw  the  various  cultural  and 
special  oliiects  as  orthograiifiic  drawings,  and  people  who 
know  how  to  rfigiti/e  these  (lrawin<)s  using  interactive 
computer  e(|uipiiieril  lha'  creates  the  data  base  The  data 
base  design  group  shouid  lie  led  by  engineers  who  pay 
attentron  to  the  careful  balancing  of  edge  caiiacities, 
intersection  limits,  moving  objects,  stiiHiial  effects,  tfie 
allocation  of  edges  to  various  versions  of  objects  as  they 
are  viewed  at  various  ranges,  retrieval  (iroblems,  and 
overloail  jiroblems  Their  goal,  however,  should  tie  to 
match  the  general  design  determined  in  the  initial  stejis 
and  related  directly  to  the  training  jiroblem. 
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CONCLUSION 

irTi.ic)*’  c|fn('r.iln)n  systfriis  provfdf'  traminq 
(levK  C (Icsiynos  ^villi  .)  iinKiin'  r.h jlicncic  sincf  thcv  cannot 
pfovuti'  any  scene  content  ontil  tl'ey  ate  (trttfjtain 

met!  tliey  Oenianit  ilelailed  scene  (lesic)ns  and  desiqn  ra 
Ii()n4tles  Previous  syslettis  wet«*  as  recti’  as  the  scalt*  ol  tde 
model,  or  the  si/e  o<  the  him,  would  (termit,  includinq 
sonir'  unitjutt  cues,  some  irrelevctttt  cues,  and  some  inarlver 
tent  distortiorts  of  otlierwise  relevant  cues  With  care,  diqi 
tal  systr'iTts  can  iiroviiie  exat  tly  those  cues  rertuired  for  oji 
timum  learninq  and  transfer  The  itrimary  requirement  is 
for  Careful  analysis  of  visual  cue  involvenient  in  the  tasks 
and  task  elements  to  t)e  trained,  and  precise  rjefinition  of 
the  learning  processes  involved 


REFERENCES 

1 Fitts,  PM,  Factors  in  Comjtlex  Skill  Learning,  in 
Training  Research  and  Erlucation,  ed  R Glaser, 
Pittslnirgh  University  of  Piltslnirgh  Press,  1962 

2 Grerjory,  R L The  Display  Problem  of  Flight  Simu 
lation.  Royal  Aeronautical  Society  Symposium  on 
■'Theory  and  Practice  in  Flight  Simulation,'  8 April 
1976 


3 Caro,  PW  Some  Factors  Influencing  Transfer  of 
Simulator  Training,  Royal  Aeronautical  Society 
Symposium  on  "Theory  anrf  Practice  in  Flight  Sim 
Illation, " 8 A[)ril  1976 

4 Smith,  B A Waters,  B K anti  Erlwards,  B J , Cogni 
tive  Prelraining  of  the  T 37  Overheatl  Traffic  Pat 
tern  USAF  FHuman  Resources  Laboratory  (FT), 
Williams  AFB,  Arizona,  AFFIRLTR  7,  1 Decemtier 
1976 

5.  Wheel,  C A , Simulators  in  Fliglit  Training  A Pilot's 
View.  U S.  Naval  Institute  Proceedings,  Oct  1976, 
pp  51  57. 

6.  Roscoe,  S.N.,  Visual  Cue  Requirements  in  Imaging 
Displays  Paper  presented  at  the  USAF  IMAGE  Con 
ference,  Williams  AFB,  Arizona,  17  18  May  1977 

7.  Ritchie,  M L.,  Distance,  Illusion  anil  Fidelity  in  Syn 
thrrsized  Images.  Paper  presented  at  the  USAF 
IMAGE  Conference,  Williams  AFB,  Arizona,  17  18 
May  1977 

8.  Miller,  R.B.,  Chapter  6,  Task  Description  and  Analy 
SIS,  in  Gagne,  R.M.,  Psychological  Principles  m Sys 
tern  Development,  Flolt,  Rinehart  and  Winston,  New 
York,  1962. 


155 


ABOUT  TH[  AUTHORS 


VR.  IPMRV  STARK  cufu'nttii  a Sfa^^  Sch’ut<it  io'i  Human  factcii  in  The 
Link  Viviiinn  <'■(  the  Soi.ieT  Ccm/atui/ ' J Viw  Bnuneii  Vevefoinent  VetniTtment . 
Ha  ‘•.edpi'niibiCifiei  incCtide  the  den<n<t<C'n  fraininei  device  leqtiiie- 
mi’tiTs  fioi  lu'u' a< ‘itit’iiu’  And  iuTf,Ace  iimntatirn  iintemi  and  device!:,  in 
ha  cAieeT  at  Link,  Pi.  St.xik  hai  ixiT  tic  i in  ted  in  the  desitin  oii  a uiide 
vaXietH  ! imniativn  iilitems,  and  ruxi  I’et^i'lmed  a number  ifarfu'5 
txaimna  dei'ice  cvncepti  and  ’iei/ni xemen ti , and  hai  anatnzed  uiet  Tequite- 
i^i'i  theiT  imiMict  cn  device  deiian.  Pi.  Stalk  teceived  the  Ph.P. 
in  piiichclviin  ^ii'm  f(u’  O/kp  Sfaft’  Un ivei  i i tH  and  ii  a membcT  o<  the 
American  Pii/chvfoqicaf  Aavc  iaticn,  Pennii/ivania  PiHclwi’i’iiicaf  Aarci- 
ativn,  and  the  Homan  FaetcTi  Societn. 


MR.  U7LLIAM  S.  BtNMfTT  ii  .MatWin’i  Simoiatii’n  RcijuiTementi  ^cT  the  Link 
ViViiwn  of  the  Cvmpani/,  a paiticn  which  inciudei  technical 

maxket  pfanninfi . .Mi.  Bemn.’T'T  waj  pTeviouiti/  aaociated  with  xeieaTch 
and  devet'ci.ment  ptogtam!.  in  digital  image  geneiaticn,  and  in  paxticulai, 
oiteTactive  giaphic  methvdi  ^ox  the  ccnitxuc  ticn  digital  image  data 
bail’s.  He  xece.ived  a B.S.E.E.  degxee  ^xvm  Caxnegie  ktellcn  UnivexiitH, 
and  ii  the  authox  ieve.xal  booki  cn  logic  deiign  and  micxoccmiTutexi . 


MR.  GEORGE  M.  B0R5T  fuii  been  emplcijed  bg  the  Link  Viviiion  of,  the  Singex 
Ccm/Mn/f  ai  a Technical  Jlluitxatcx  iince  1956.  He  ii  an  acccmpliihed 
cxeatvx  of  tXue-pcAipective  colcx  and  black  and  white  illuitxaticni  of 
complex  technical  concepti,  incliuiing  iimnlated  viioal  diiplaii  icenei 
pxvdoced  bg  computex  image  genexa.tion.  Hii  expexience  ai  a pxivate 
pilot  hai  ccntXibuted  iignificantlii  to  the  illuitxationi  loxeiented  in 
fhii  ^ttpi’i,  which  piLXpoxt  to  ihow  the  viioal  cuei  comidexed  impoxtant 
fox  pilot  txaming.  He  ii  a majox  in  the  klew  Voxk  Axmg  national  Guaxd 
and  hai  io’ii'fii  ai  commanUoui  of  a field  axtillexif  ixittexn,  an 

infantxg  headgoaxtexi  comi^xing,  and  an  infantxu  line  com/xtnif,  ai  wx’ll  ai 
being  amgned  to  inch  poiitioni  ai  Seniox  CCS  Tactical  Officer,  battalion 
Ixecative  Officex,  and  Brigade  Intelligence  and  Seciixito  Officex.  Mi. 
Bfiif  ii  a graduate  Chicago  Technical  College  and  Bioomi’  Technical 
College  in  Binghamton,  Hew  Moifc,  wtiexe  he  mtfoxed  in  indoitxial  illui- 
txation.  Hii  militaxg  training  includei  Impixe  State  Hilitaxg  Academii, 
Fort  Sill  Ax-tillerg  Officer  Career  School,  Foxt  Benning  Infantxu  Officex 
School,  and  the  Axmg  Command  and  General  College. 


156 


CIG  EDGE  CONSERVATION  EVALUATION  AND  APPLICATION 
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INTRODUCTION 

This  paper  addresses  a new  approach  to 
the  visual  scene  presentation  within  a wide- 
angle  optical  mosaic  display  of  computer- 
generated  imagery,  and  a means  of  determining 
and  analyzing  the  visual  system  processing 
and  display  capacities  being  utilized.  An 
area  O'’  interest  (AGI)  presentation  concen- 
trates visual  detail  in  that  portion  of  the 
entire  display  to  which  the  pilot's  immediate 
attention  is  directed.  The  AOI  transverses 
the  display  in  real-time  in  coordination  with 
the  movement  of  the  pilot's  head.  The  result 
is  a more  efficient  and  effective  utilization 
of  system  processing  capacities  which  can  be 
"•easured  with  the  system's  visual  parameter 
monitor  (VPM).  An  operational  description  of 
the  VPM  and  AOI,  together  with  an  example  of 
their  integrated  application,  constitutes  the 
body  of  this  report. 

VISUAL  PARAMETER  MONITOR  (VPM) 

&gSGT>tr’TIPTi 

Computer  Image  Cjeneration  systems  are 
relatively  new  in  the  simulation  technology; 
and,  therefore,  a data  bank  of  information 
needs  to  be  compiled  that  would  be  useful  for 
generating  training  and  engineering  specifi- 
cations that  will  satisfy  user  requirements, 
■'heoretically,  the  training  requirement 
Should  drive  the  general  systems  specifica- 
tions ' ^or  example,  field-of-view  requirements 
should  be  based  on  a specific  training  task 
♦or  a given  aircraft).  The  engineering 
specifications  should  then  optimize  the  pa- 
rameters that  limit  and/or  define  the  visual 
processing  potential  of  the  system.  The 
Visual  Parameter  Monitor  (VPM)  feature  of  the 
Advanced  Simulator  for  Pilot  Training  (ASPT) 
provides  a tool  for  both  training  researcher 
and  engineer  to  investigate  the  Computer  Image 
Generation  (CIG)  system  hardware  and  hardware 
limiting  parameters.  The  VPM  can  be  applied 
in  several  CIG  functional  areas.  Applications 
include  an  ability  to  conduct  environment  data 
base  statistical  analyses,  experimental  con- 
figuration definition,  maintenance  trouble- 
shooting, real-time  performance  monitoring, 
and  more  accurate  specification  of  future  CIG 
system  requirements.  These  functional  areas 
can  be  categorized  under  two  basic  modes  of 
CIG  system,  operation:  off-line  and  on-line. 
Real-time  scene  generation  is  accomplished  in 
the  on-line  operational  mode.  Data  base 
management  operations  and  maintenance  diagnos- 
tic operations  are  performed  in  the  off-line 
operational  node. 


In  the  on-line  operational  mode,  the 
system  accomplishes  its  real-time  scene 
generation  task  in  a serial  computational 
manner.  Data  necessary  to  compute  each  scene 
is  requested  '^rom  'he  simulator  computer  each 
l/TP  second,  and  the  corresponding  scene  is 
displayed  approximately  three  television  frame 
times  (3/30  second)  from  the  time  of  receiving 
new  or  extrapolated  scene  data.  The  CIG 
system  is  configured  into  three  major  equip- 
ment areas:  The  General  Purpose  (GP)  compu- 
tational system,  the  Special  Purpose  (SP) 
computational  system,  and  the  CRT  electronics 
(Figure  1).  Three  time  frames  are  utilized 
for  processing  the  display  data.  The  t>e 
phases  are  associated  with  the  33  millisecond 
frame  time  in  which  the  data  is  processed  in 
response  to  an  updated  viewpoint  position  and 
attitude.  The  equipment  that  performs  these 
three  time-phased  tasks  is  referred  to  as 
Frame  I,  Frame  II,  and  Frame  III,  respec- 
tively. While  the  Frame  III  hardware  is  pro- 
ducing the  video  signal  which  is  used  to 
present  the  picture  being  observed.  Frame  II 
is  preparing  information  to  be  used  for  the 
Picture  to  follow  in  the  next  television  time 
frame  period,  and  Frame  I is  working  on  data 
for  the  frame  'o  follow  that  (Figure  2). 

Frame  I operations  are  performed  by  the  CIG 
system's  GP  dual -processor  computer  cor  lex. 
During  the  first  33  milliseconds,  this  com- 
puter requests  data  from  the  simulator  com- 
puter and  performs  frame  rate  processing 
functions  necessary  to  qenerate  data  for  the 
special-purpose  hardware.  The  GP  computer 
then  processes  these  inputs  to  generate 
necessary  data  for  Frame  II  operations  and 
any  output  messages  required  to  the  mainte- 
nance console. 

The  following  Frame  I parameters  are 
monitored  by  VPM: 

• ACTIVE  OBJECT  COUNT 

• POTENTIALLY  ACTIVE  OBJECT  COUNT 

• NUMBER  OF  ACTIVE  MODELS 

• NUMBER  OF  MODELS  CHANGING  PER  FRAME 
TIME 

• NUMBER  OF  LEVEL  OF  OFTAIL  CHANGES 
PER  UNIT  TIME 

• NUMBER  OF  NEW  MODELS  TO  BE  ADDED 
TO  ACTIVE  FNVIRONMENTS/FRAME  TIMf 

• DEPTH  OF  OUEUE  OF  NEW  MODELS/ 

FRAME  TIME 

• NUMBER  OF  MODELS  THAT  GO  TO  LEVEL 
OF  DETAIL 

• NUMBER  OF  FACES  INTO  FRAME  11 

• NUMBER  OF  OBJECTS  PER  CHANNEL 
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Figure  2.  ASPT  CIG  System  Functional  Diagram 


The  calculation  of  required  edge  and 
grey  shade  information  is  performed  by  the 
frame  II  hardware.  The  major  functions  of 
this  equiiment  are  edge  processing,  fading 
and  light  brightness  corrections,  vector 
transformations,  and  priority  processing. 

The  following  Frame  II  parameters  that  are 
monitored  include: 

• FRAMi;  II  TOTAL  FDGF  COUNT  (INTO  FDGF 
PROCESSOR) 

• FRAME  III  total  EDGE  COUNT  (OUT  OF 
EDGE  PROCESSOR  TO  FRAME  III) 

• NUMBER  OF  ACTIVE  FACES 

• NUMBER  OE  ECGES/CHANNEL/FRAME 

The  Frame  III  hardware  creates  the  video 
signals  for  the  display  projector  by  succes- 
sively processing  and  accumulating  data  for 
each  raster  scan  line.  The  data  is  accumu- 
lated for  each  raster  scan  line  of  each  of 
the  display  channels,  and  then  converted  to 
video  output  signals.  The  major  portions  of 
the  Frame  III  hardware  are  edge  storage/edge 
generators,  video/video  storage,  priority 
resolvers  and  video  processors.  The  Frame  III 
parameters  that  are  monitored  in  real-time 
a re: 

• MAX  EDGE  CROSSINGS/SCAN  LINE/FRAME 

• NUMBER  OF  OBJECTS  IN  PRIORITY 
CONFLICT 

• MAX  NUMBER  OF  EDGE  CROSSINGS/L INE/ 
SYSTEM 

• NUMBER  OF  EDGE  CROSSINGS  PER  CHANNEL 
PER  SELECTED  LINE 

In  the  off-line  operational  mode,  the 
system  performs  data  base  and  maintenance 
diagnostic  operations.  Data  base  diagnosis 
entails  the  debugging  of  operational  data 
bases  for  training  exercises.  With  the  VPM, 
much  of  the  trial  and  error  procedure  can  be 
removed  from  the  data  base  diagnostic  se- 
quence. The  environmental  data  base  for  a 
CIG  visual  system  is  basically  defined  by 
straight  line  segments  referred  to  as  "edges." 
These  straight  line  segments  are  combined  to 
form  two  and  three  dimensional  features  of 
the  environment.  The  organization  and  com- 
plexity of  the  environmental  data  base  is 
constrained  by  CIG  system  hardware  and  soft- 
ware limiting  parameters.  It  is  essential 
that  in  specifying,  developing,  and  modifying 
an  environmental  data  base,  the  relationship 
between  limiting  parameters  of  the  visual 
system  and  the  desired  data  base  be  made 
available  for  analysis.  The  VPM  provides  a 
systematic  means  of  categorizing  and  cata- 
loging visual  scenes  generated  from  existing 
environmental  data  bases.  Each  visual  scene 
cataloged  can  be  recorded  photographically 
and  will  include  the  extremes  and  statistics 
for  each  key  system  parameter.  The  software 
provides  capabilities  for  both  man-in-the-loop 


and  preprogrammed  control  of  the  flight 
pattern  through  the  environment  and  allows 
the  experimenter  to  preprogram  the  statisti- 
cal parameters  and  values  which  will  auto- 
matically stop  the  viewpoint  motion  to  pro- 
vide a visual  scene  freeze.  A printout  of  a 
complete  set  of  statistics  for  the  frozen 
visual  scene  can  then  be  provided  by  an  oper- 
ator conmand. 

Catalogs  can  be  developed  which  will 
logically  categorize  and  catalog  mission 
representative  visual  scenes  from  any  environ- 
ment, Individual  catalogs  would  consist 
mainly  of  photographs  accompanied  by  parameter 
statistics  and  descriptive  information  indi- 
cating the  viewpoint,  location,  and  attitude 
within  the  environment.  Investigations  with 
VPM  would  provide  a means  to  analyze  the 
relative  and  absolute  relationships  between 
the  various  CIG  system  limiting  parameters  as 
they  relate  to  typical  environmental  data 
bases.  This  information  would  be  extremely 
beneficial  for  specifying  any  CIG  systems  and 
their  associated  data  base  requirements. 

Interaction  with  CIG  parameter  processing, 
both  on-line  and  off-line,  is  via  a continuous 
display  on  a high-speed,  interactive  display 
terminal  CRT.  this  display  is  provided  on  an 
Infoton  Vistar/GTX  Display  Terminal  and 
permits  the  operator  to  select  parameters  with 
the  terminal  keyboard.  Under  keyboard  con- 
trol, the  operator  has  the  option  of  reading 
certain  CIG  limiting  parameters  or  any 
special-purpose  computer  data  bus  quantities. 
Standard  displays  would  include  all  or  a 
selected  subset  of  the  Frame  I,  II,  and  III 
parameters  previously  listed.  In  addition  to 
the  CRT  output,  other  mediums,  such  as  the 
line  printer,  are  available  to  the  user  of 
the  VPM. 

AREA-OF- INTEREST  DESCRIPTION 

An  area-of-interest  projection  in  a wide- 
angle  field-of-view  (FOV)  display  in  its  pure 
form  would  present  visual  scene  information 
only  in  the  portion  of  the  display  in  which 
the  pilot  is  looking.  The  size  of  the  AOl  nay 
vary,  depending  upon  the  application.  For 
some  applications,  such  as  air-to-surface 
weapons  delivery,  certain  visual  information 
is  necessary  throughout  the  display.  In 
cases  such  as  this,  a compromise  can  be 
made.  Visual  reference  cues  such  as  horizon 
and  surface  texture  can  be  provided  as 
peripheral  cues  throughout  the  display, 
whereas  detailed  visual  Information  would  only 
be  displayed  in  the  AOl. 

The  implementation  of  an  AOl  display  for 
the  ASPT  was  performed  in  a nunter  of  steps. 
The  first  step  was  to  generate  a number  of 
fixed-size  hoods  to  occlude  the  visual  scene 
laying  outside  the  desired  FOV.  (Figure  3) 
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These  hoods  were  generated  as  the  moving  rode! 
of  the  environmental  data  base  which  was  fixed 
to  the  viewpoint,  aligned  parallel  to  the 
longitudinal  axis  of  the  simulator  aircraft 
and  flew  the  same  flight  path.  The  next  step 
was  to  generate  computer  software  capable  of 
creating  a hood  with  any  desired  FOV  in  real- 
time via  operator  interaction.  At  this  point, 
the  data  base  features  obscured  by  the  hood 
were  still  being  processed  by  the  conputer  but 
were  not  seen  in  the  display,  since  the  hood 
had  priority  over  all  other  objects.  (Figure 
A)  It  was  now  desirable  to  eliminate  from 
processing  those  objects  which  did  not  inter- 
sect the  FOV,  in  order  to  permit  the  concen- 
tration of  objects  and  edges  within  the  AOI. 
The  hood,  however,  was  still  necessary  to 
occlude  the  portion  of  a displayed  object 
laying  outside  the  AOI.  The  ideal  situation 
would  have  been  to  eliminate  the  hood  and 
truncate  an  object  at  the  AOI  boundaries; 
however,  this  would  have  involved  hardware 
modifications  requiring  excessive  lead  time. 
Since  an  evaluation  of  the  AOI  concept  had  a 
pressing  deadline,  it  was  decided  to  postpone 
the  incorporation  of  this  refinement.  Hard- 
ware and  software  modifications  were  also  made 
at  this  time  to  make  the  hood  independent  of 
the  environmental  moving  model  and  enable  the 
AOI  to  be  slewed  throughout  the  cockpit  dis- 
play in  real-time.  Provision  was  then  made  to 
incorporate  a helmet  slaving  device  (HSD)  in 
one  of  the  simulator  cockpits.  (See  Figures 
5 and  6.)  This  system  consists  of  a helmet 
with  a pair  of  infrared  sensors  mounted  on 
both  sides,  two  sensor-surveying  units,  sight 
control  unit  and  a control  panel.  Two  sensor- 
surveying units  are  hard-mounted  to  the  cock- 
pit on  each  side  and  slightly  to  the  rear  of 
the  pilot.  These  units  generate  infrared 
light  beams  which  trigger  signal  pulses  when 
they  Sweep  over  the  helmet  detectors.  Th® 
sight  control  unit  contains  the  digital  cir- 
cuitry for  converting  the  detector  pulse 
signals  from  the  helmet  sensors  and  sensor- 
surveying units  into  digital  angles,  and 
converting  these  angles  into  azimuth  and 
elevation  signals  for  controlling  the  line 
of  sight  of  the  AOI.  Preliminary  test  opera- 
tions indicated  that  a smooth,  continuous 
movement  of  the  hood  without  any  jitter  could 
be  obtained  with  0.5  degree  filtering.  Pilots 
also  observed  that  it  was  extremely  difficult 
to  maintain  their  orientation  without  a 
horizon  throughout  the  display.  It  was  found 
that  redefining  the  hood  as  a two-dimensional 
object  allowed  the  horizon  to  have  priority 
over  the  hood,  with  the  hood  still  having 
priority  over  all  other  objects.  Figure  7 
exhibits  this  feature. 

This  configuration  was  used  in  an  evalua- 
tion conducted  in  support  of  AS0/SD2A  Simu- 
lator SPO  Project  2360,  Fighter/Attack  Visual 
Simulation.  The  major  objective  of  this 
evaluation  was  to  determine  the  size  of  the 


AOI  required,  in  order  to  adequately  perform 
air-to-surface  weapons  delivery.  A second 
phase  of  this  study  is  planned  to  evaluate 
the  effect  that  peripheral  cues  (in  addition 
to  the  horizon)  will  have  on  the  size  AOI 
required  for  adequate  air-to-surface  weapons 
delivery  performance.  Engineering  modifica- 
tions will  be  performed  to  permit  operation 
in  this  phase  without  a hood  and  yet  retain 
distinct  boundaries  of  the  AOI  through  the 
truncation  of  the  portion  of  an  object 
extraneous  to  the  AOI.  The  peripheral  cues 
would,  of  course,  be  shown  throughout  the 
displ ay. 

AN  AOI  application 

The  basic  premise  for  an  AOI  presentation 
in  a wide-angle  FOV-CIG  display  is  to  conserve 
system  edge  processing  capacity  by  displaying 
more  visual  data  base  edges  in  the  area  to 
which  the  pilot  " atter'*'io''  is  directed,  at 
the  sacrifice  of  displaying  fewer  edges  in  the 
periphery.  This  results  in  a more  efficient 
utilization  of  the  system  edge  processing 
capacity  and  conserves  resources  by  requiring 
less  computer  processing  hardware  than  would 
be  required  by  a full  FOV  display  for  a data 
base  of  given  edge  density.  In  other  words, 
a system  having  a given  edge  processing 
capacity  which  could  display  a data  base  of 
given  edge  density  with  the  full  wide-angle 
FOV  display  could  display  a more  detailed  or 
denser  data  base  with  an  AOI  display.  Since 
the  density  of  the  displayable  data  ise  is 
inversely  proportional  to  the  size  jt  the  AOI 
and  the  CIG  system's  costs  are  directly  pro- 
po’tional  to  system  edge  capacity,  consider- 
able cost  savings  could  be  achieved  utilizing 
this  approach. 

To  effectively  determine  the  efficiency  of 
an  AOI  application,  a means  to  measure  the  CIG 
visual  system  parameters  for  various  configu- 
rations is  required  in  order  to  make  the 
necessary  comparisons.  The  VPM,  as  previously 
described,  provides  a valuable  tool  for  such 
a comprehensive  investigation.  Figures  8 and 
9 are  photographs  taken  from  the  exact  same 
viewpoint  (with  two  different  size  AOI's)  of 
a CIG  scene  of  two  different  edge  densities. 
They  serve  to  illustrate  the  potential 
application  of  the  AOI  and  VPM  concepts. 

Tables  1 and  2 list  the  counts  for  some  of  the 
CIG  visual  system  parameters  for  Figures  8 and 
9,  respectively. 

The  AOI  size  ♦'or  Figure  8 is  70°  hori- 
zontal by  50°  vertical,  whereas  Figure  9 has 
an  AOI  size  of  50°  horizontal  by  30°  vertical. 
As  can  be  observed  from  the  figures  and 
tables,  the  scene  in  Figure  9 is  denser  than 
the  scene  in  Figure  8.  The  AOI  size  for 
Figure  9 is  less  than  half  that  of  Figure  8 
and  its  scene  contains  1.7  times  as  many 
edges.  Since  the  purpose  of  this  paper  is 
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Figure  5.  Helmet  Slaving  Device  System 


Figure  6.  HSO  Block  Diagram 
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merely  to  <ic<iudinf  the  reader  with  the 
potential  henef^its  that  may  accrue  from  the 
flO!  and  Vt'V  concepts,  no  attempt  will  be  nade 
to  derive  any  conclusions  from  the  afore- 
mentioned data.  To  generate  any  such  con- 
clusions would  require  a much  more  detailed 
and  sophisticated  analysis,  which  is  beyond 
the  scope  of  this  paper. 

SUMMARY 

Both  the  VPM  and  AOI  present  considerable 
resource  conservation  tools  for  CIG  systems 
applications  and  design  considerations.  The 


AOI  concept  provides  a technique  whereby  »he 
visual  system  capacity  fan  be  fX)re  efficiently 
utilized  by  dynamically  concentrating  image 
detail  in  the  critical  area  of  'he  display. 
Since  CIO  system  costs  are  directly  propor- 
tional to  the  system  edge  generation  capacity, 
an  AOI  presentation  offers  a considerable  cost 
saving  potential.  The  VPM  is  a unique  tool 
that  provides  the  researcher  with  an  exact 
definition  of  'he  visual  systems  configuration 
for  any  given  experiment.  It  allows  the 
modeler  and  the  engineer  access  to  parameters 
that  influence  data  base  requirements  and 
special-purpose  hardware  designs. 


Figure  8.  AOl  Display  (70°  x 50°) 


TABLE  1. 

VPM  COUNTS  FOR  FIGURE  8 

Potentially  Active  Models 

64 

Active  '‘ode Is 

31 

Potentially  Active  Objects 

114 

Active  Objects 

63 

Frame  11  Edges 

1991 

Frame  111  Edges 

(Potential ly  Visible) 

667 

.65 


Figure  9.  AOI  Display  (50°  x 30°) 


TABLE  2.  VPM  COUNTS  FOR  FIGURE  9 
Potentially  Active  Mode's  66 

Active  Models  33 

Potentially  Active  Objects  129 

Active  Objects  78 

Frame  II  Edges  3236 

frame  III  Edges  (Potentially  Visible)  1134 
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LABORATORY  DEMONSTRATION  OF  COMPUTER  SPEECH 


RECOGNITION  IN  TRAINING 
ROBERT  BREAUX 

Ndval  Traininq  Equipn'ent  Center 


INTRODUCTION 

Baclqround 

The  Naval  Training  Equipment  Center's 
Human  Factors  Laboratory  seeks  to  identify  and 
measure  those  behaviors  which,  when  improved 
through  training,  result  in  superior  perform- 
ance on  the  job.  Thus,  the  laboratory  seeks 
to  combine  new  technology  developments  with 
current  advances  in  learninq/training  theory 
and  techniques. 

One  such  technology  development  is  com- 
puter speech  recognition.  The  advantage 
brought  to  training  by  this  technology  is  the 
capability  to  objectively  measure  speech  be- 
havior. Now,  traditional  training  techniques 
for  jobs  which  are  .primarily  speech  in  nature 
require  so'ieone  who  can  listen  to  what  is 
being  said.  Otherwise,  no  measure  of  the 
speech  behavior  is  possible.  In  the  U.  S. 
Navy,  jobs  which  are  primarily  speech  in 
nature  include  the  Ground  Controlled  Approach 
(GCA)  and  Air  Intercept  (AIC)  controllers,  as 
well  as  the  Landing  Signal  Officer  for  carrier 
operations,  various  Naval  Flight  Officer  posi- 
tions such  as  the  Radar  Intercept  Officer,  and 
the  Officer  of  the  Deck  in  ships  operations. 

In  addition  to  the  requirement  of  having  an 
instructor  listen  to  the  speech  behavior, 
training  in  these  situations  often  requires 
another  person  to  cause  changes  in  the  envi- 
ronment which  correspond  to  the  trainee's 
commands.  For  the  GCA  and  AIC  tasks,  this 
takes  the  fom  of  "pseudo"  pilots  who  "fly" 
a simulated  aircraft  target.  This  2:1  ratio 
of  support  personnel  to  trainee  results  in  a 
relatively  high  training  cost. 

Previous  studies  have  demonstrated  that 
in  analogous  situations,  it  has  been  possible 
to  achieve  savings  of  manpower  and  training 
time  while  gaining  a uniform,  high-quality 
student  output  by  introducing  automated  adap- 
tive instruction.  This  advanced  technology, 
if  applied  to  GCA  controller  training,  would 
bring  in  its  standard  benefits  such  as  objec- 
tive performance  measurement  and  complete 
individualized  instruction.  Moreover,  for  GCA 
controller  students,  a more  fully  automated 
system  could  provide  greater  realism  in  the 
performance  of  "aircraft"  under  control  by 
accessing  directly  the  computer  model  of  air- 
craft dynamics  rather  than  relying  on  the 
undetermined  skills  of  a variety  of  pseudo- 
pilots.  Additionally,  the  rapid  processing 
of  an  automated  system  would  make  possible 
extrinsic  feedback  of  task  performance  to  the 
trainee  in  real-time. 


But  in  order  to  realize  an  automated 
adaptive  training  system,  it  is  essential 
that,  in  addition  to  values  of  overall  system 
performance,  some  relevant  aspect  of  the 
trainee's  activity,  in  this  case  his  speech 
behavior,  be  accessible  to  the  performance 
measurement  subsystem.  At  this  point,  our 
technology  review  suggested  that  the  state  of 
the  art  in  machine  understanding  of  speech 
could  furnish  the  means  for  direct  entry  of  a 
trainee's  advisories.  For  some  whose  ac- 
quaintance with  this  possibility  is  limited 
to  the  science  ficti'n  of  film,  television  and 
print  media,  the  response  might  be  "Of  course.' 
'i^hy  not?"  Those  more  familiar  with  the  prob- 
lem might  say,  "Not  yeti"  The  reality  is  that 
while  computer  understanding  of  continuous 
unrestricted  speech,  without  pretraining,  by 
any  individual  who  approaches,  is  still  a 
long  way  off,  there  exists  today  a capability 
for  machine  recognition  of  isolated  utterances 
drawn  from  a small  set  of  possible  phrases. 

The  computer  in  this  case  must  be  pre-trained 
on  the  language  set  with  speech  samples  for 
each  individual  speaker. 

Automated  Adaptive  Instruction 

Automated  adaptive  training  has  a number 
of  advantages  over  the  more  traditional 
approaches  to  training.  Automation  of  train- 
ing relieves  the  instructor  of  busywork  chores 
such  as  equipment  setup  and  bookkeeoing.  He 
is  thus  free  to  use  his  time  counseling  stu- 
dents in  his  role  as  training  manager.  In 
adding  the  adaptive  component,  efficiency  is 
increased  with  more  training  per  unit  time. 
Individualized  instruction,  with  its  self- 
paced  nature  maintains  the  motivation  of  the 
trainee.  Objective  scoring  is  potentially 
more  consistent  than  subjective  ratings.  Uni- 
formity can  be  maintained  in  the  proficiency 
level  of  the  end  product,  the  trainee.  But, 
tasks  requiring  verbal  cormands  have  thus  far 
been  unamenable  to  automated  adaptive  train- 
ing techniques.  Traditionally,  performance 
measurement  of  verbal  commands  has  required 
subjective  ratings.  This  has  effectively 
eliminated  the  potential  development  of  indi- 
vidualized, automated,  self-paced  curricula 
for  the  training  of  the  aforementioned  Landing 
Signal  Officer,  the  Air  Intercept  Controller, 
the  Ground  Controlled  Approach  Controller,  and 
others.  Computer  speech  recognition  of  human 
speech  offers  an  alternative  to  subject  per- 
formance measurement  by  providing  a basis  of 
Objectively  evaluating  verbal  commands.  The 
current  state  of  the  art  has  allowed  such 
applications  as  automated  baggage  handling  at 
Chicago's  O'Hare  airport.  A more  sophisticat- 
ed reconnition  system  1s  required  for  training. 
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however.  To  that  end,  the  Naval  Air  Systems 
Comnand  and  the  Advanced  Research  Projects 
Aqency  have  supported  the  Naval  Training 
iquipment  Center  Human  Tacfors  Laboratory  in 
efforts  to  establish  design  guidelines  for 
training  systems  which  combine  automated 
adaptive  training  technologies  with  computer 
speech  recognition  technology.  The  particular 
application  chosen  is  the  Precision  Approach 
Radar  (PAR)  phase  of  the  GCA. 

TRAINING  REQUIRLMfNTS 
T he  GCA  A£p  1 i_ca_t  i o_n 

The  tasl  of  the  GCA  Controller  is  to 
issue  advisories  to  aircraft  on  the  basis  of 
information  from  a radar  indicator  containing 
both  azimuth  (course)  and  elevation  (glide- 
path)  capabilities.  The  aircraft  target  pro- 
jected on  the  elevation  portion  of  the  indi- 
cator is  mentally  divided  into  sections  by  the 
controller.  This  is  because  the  radio  termi- 
nology (R/T)  for  glidepath  is  defined  in  terms 
of  these  sections.  Thus,  at  any  one  point  in 
time,  one  and  only  one  advisory  is  correct. 
Conversely,  each  advisory  means  one  thing  and 
only  one  thing.  This  tightly  defined  R/T  is 
perfect  for  application  of  objective  perform- 
ance measureisent . The  drawback,  of  course,  is 
that  performance  is  verbal  and  has  thus  far 
required  subjective  ratings.  In  addition,  the 
time  required  for  human  judgment  results  in 
inefficient  performance  measurement.  The 
instructor  cannot  catch  all  the  mistakes  when 
there  are  many. 

Nejds  and  Objectives 

The  major  behavioral  objective  of  current 
GCA  training  is  to  develop  the  skill  to  ob- 
serve the  trend  of  a target  and  correctly 
anticipate  the  corrections  needed  to  provide 
a safe  approach.  The  standard  R/T  is  designed 
to  provide  a medium  to  carry  out  this  objec- 
tive, and  GCA  training  exposes  the  student  to 
as  many  approaches  as  possible  so  that  the 
trainee  may  develop  a high  level  of  fluency 
with  his  R/T. 

The  primary  need  to  fulfill  its  objec- 
tive is  for  GCA  training  to  teach  the  skill 
of  extrapolation . A controller  must  recognize 
as  quickly  as  possible  what  the  pilot's  skill 
is.  He  must  recognize  what  the  wind  is  doing 
to  the  aircraft  heading.  Then  he  must  inte- 
grate this  with  the  type  aircraft  to  determine 
what  advisories  to  issue. 

Advanced  Technology 

The  major  behavioral  objectives,  then, 
can  more  efficiently  be  achieved  through  the 
application  of  computer  speech  recognition 
technology,  and  thereby  the  application  of 
advanced  training  technologies.  This  is 
because  with  objective  assessment  of  what  the 


controller  is  saying,  objective  performance 
measurement  is  possible,  and  thus  we  have  the 
capability  of  individualized  instruction. 

The  use  of  simulateii  environmental  conditions 
allows  the  development  of  a syllabus  of  grad- 
uated conceptual  complexity.  The  integration 
of  these  components  results  in  an  automated, 
self-paced,  individualized,  adaptive  training 
system. 

The  job  of  the  instructor  now  becomes 
one  of  training  manager.  His  experience  and 
skill  may  be  exploited  to  its  fullest.  The 
training  system  can  provide  support  in  intro- 
ducing the  student  to  the  R/T.  The  instruc- 
tor can  scan  the  progress  of  each  student  and 
provide  counseling  to  those  who  need  it. 

Simple  error  feedback  is  provided  by  the 
training  system.  Only  the  instructor  can 
provide  human  to  human  counseling  for  specif- 
ic needs,  and  the  training  system  provides 
more  time  for  this  valuable  counseling. 

TRAINING  SYSTEM  OVERVIEW 

A training  system  for  the  GCA  comptroller 
was  determined  to  require  four  subsystems, 
speech  un  lerstanding,  pilot-aircraft  model, 
performanc  measurement,  and  a syllabus.  The 
speech  understanding  subsystem  was  developed 
around  the  »1P-100  purchased  by  the  Naval 
Training  Equipment  Center  from  Threshold,  Inc., 
Cinnaminson,  New  Jersey. 

Three  major  constraints  are  imposed  by 
this  system.  Each  user  must  pre-train  the 
phrases.  Recognition  does  not  take  place  for 
random,  individual  words,  only  predefined 
phrases.  Each  phrase  is  repeated  a number  of 
tines  and  a Reference  Array  is  formed  repre- 
senting the  "average"  way  this  speaker  voices 
this  particular  phrase.  Thus,  the  second 
constraint  is  that  there  must  be  a small  num- 
ber of  phrases  (about  50)  which  are  to  be 
recognized.  If  performance  is  to  be  evalu- 
ated based  upon  proper  R/T,  each  phrase  must 
be  defined.  The  third  constraint,  due  to 
performance  measurement  requirements,  is  that 
there  be  no  ambiguous  phrases  --  right  or 
wrong  depending  strictly  on  who  the  instruc- 
tor is.  Technically,  the  GCA  application 
appears  to  be  conformable  to  these  con- 
straints . 

To  achieve  high  fidelity,  simulation 
makes  use  of  various  math  models;  The  model 
of  the  controller  is  at  the  focal  point  of 
all  other  models,  and  serves  to  provide  cri- 
teria to  the  performance  measurement  system. 

A model  of  the  aircraft  and  pilot  allows  for 
variation  in  the  complexity  of  situations 
presented  the  student.  The  principle  being 
used  here  is  that  exposure  of  a student  to 
certain  typical  situations  will  allow  him  to 
generalize  this  experience  to  real  world 
situations.  The  pilot  model  allows  for  sys- 
tematic presentation  of  various  skill  levels 
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of  pilots.  In  addition,  the  equations  used  in 
ncdelinq  the  pilot  and  aircraft  responses  also 
allow  for  introduction  of  various  wind  compo- 
nents. ''he  adaptive  variables,  pilot  skill, 
aircraft  characteristics,  and  wind  components 
are  combined  systematically  to  produce  a syl- 
labus qraduated  in  problem  complexity.  As  the 
skill  of  the  trainee  increases,  he  is  allowed 
to  attempt  more  complex  problems. 

Since  the  score  is  determined  by  the  per- 
formance measurement  system,  the  heart  of 
scorinq  is  the  model  controller,  As  it  often 
happens,  what  constitutes  "the”  model  control- 
ler is  a matter  of  some  discussion  among  GCA 
instructors.  Thus  for  automated  training 
applications,  one  must  determine  the  concepts 
which  are  definable,  such  as  how  to  compute 
a turn,  and  leave  other  concepts  to  be  devel- 
oped by  the  instructor-student  apprentice 
relationship . 

PrSULTS 

The  Problem  of  Novelty 

In  an  attempt  to  verify  the  recognition 
algorithms,  naive  adult  males  were  employed  as 
subjects.  It  was  soon  discovered  that  proba- 
bility of  correct  recognition  was  as  low  as  50 
percent  in  the  beginning  and  phrases  had  to  be 
retrained  to  increase  recognition  reliability. 
It  was  hypothesized  that  the  novelty  of  "talk- 
ing to  a machine"  was  a significant  factor  in 
the  low-recogni tion  reliability.  If  this 
initial  novelty  could  be  reduced,  it  was 
thought,  reliability  would  also  increase. 

Four  adult  males  and  four  adult  femidles  were 
used  to  compare  an  introduction  method  vs  a 
no  introduction  method.  The  introduction 
group  was  given  R/T  practice,  saying  the  GCA 
phrases  as  they  would  later  in  an  actual 
prompted  run.  The  .model  controller  was  uti- 
lized to  anticipate  for  the  subject  an  optimum 
response  every  four  seconds.  This  prompt  was 
presented  graphically  on  the  display,  as  the 
aircraft  made  the  approach.  The  subject  spoke 
the  phrase,  then  both  the  prompt  and  the  under- 
stood phrase  were  saved  for  later  printout. 

The  no  introduction  group  on  the  other  hand, 
was  not  given  practice.  Each  group  then  made 
reference  phrases.  Reliability  data  was  col- 
lected using  the  procedure  described  above  for 
P/T  practice.  A Chi-square  value  was  computed 
from  a 2 X 2 contingency  table  of  frequency  of 
runs  in  which  no  recognition  errors  occurred  vs 
frequency  in  which  one  or  more  errors  occurred, 
and  whether  there  had  been  practice  on  the 
phrases  vs  no  practice  prior  to  making  the 
voice  reference  patterns.  It  was  found  that 
Xx(l)=  3.12,  p<.10  indicating  a relationship. 
A correlation  was  computed  for  the  groups  vs 
the  number  of  different  phrases  which  were  not 
recognized  on  a run,  with  R » -.33,  pc.lO, 
indicating  a tendency  for  fewer  errors  with 
pre-practice  at  the  task.  Conclusion:  Better 
recognition  is  achieved  when  the  R/T  is  voiced 
consistently  and  unemotionally. 


Training  System  Evaluajion 

Twelve  recruits  were  used  from  the 
Recruit  Training  Command,  Orlando,  who  were  in 
their  last  few  weeks  and,  therefore,  were  priv 
ileged  with  liberty  on  the  weekend.  Each  had 
received  assignment  to  the  Navy’s  Air  Traffic 
Control  (ATC)  School.  Each  subject  was  inter- 
viewed for  willingness  to  participate  in  an 
'experiment"  during  liberty  hours  concerning 
ATC,  and  each  was  informed  that  for  their  time 
they  would  be  paid.  Each  subject  expressed  a 
desire  to  become  an  air  confrolman. 

Each  subject  was  issued  at  the  interview 
those  portions  of  the  programmed  instruction 
booklets  normally  used  by  the  ATC  School  re- 
lating to  the  Precision  Approach  Radar  (PAR) 
phase  of  GCA,  and  was  requested  to  complete 
the  material  prior  to  arrival  at  the  lab. 

Each  subject  was  exposed  in  the  lab  to  approx- 
imately three  hours  of  "introduction."  During 
this  time  the  system  collected  and  validated 
the  voice  pattern  of  the  subject  for  each  of 
the  PAR  phrases.  During  the  between-run  inter 
vals,  audio  recordings  were  played  which 
explained  and  reviewed  the  PAR  R/T.  Recogni- 
tion accuracy  by  the  system  on  the  final  run 
of  each  subject  ranged  from  81. 5T  correct  to 
98.5%  with  an  average  of  94.1%  correct  recog- 
nition. 

Subjects  were  then  exposed  to  "free"  runs 
in  which  they  had  complete  control  over  the 
aircraft.  It  was  found  that  recognition  accu- 
racy suffered  during  the  first  few  runs.  The 
change  from  a system  which  fully  prompted  the 
subject  on  the  R/T  to  a full  scoring  system 
which  required  the  subject  to  initiate  all 
R/T,  resulted  in  a noticeable  change  in  the 
voicings  of  the  R/T.  Hesitation,  repetition, 
and  corrections  were  made  which,  of  course,  is 
not  withiri  the  capability  of  the  speech  system 
to  accurately  recognize.  R/T  voicing  improved 
with  practice,  however. 

Subsequent  School  _^valuation 

The  ATC  School  was  informed  of  which  per- 
sons had  been  exposed  to  the  lab  PAR  system. 
Eight  of  the  original  12  subjects  completed 
the  14  week  school.  Four  dropped  for  "various 
academic  and  ncnacademic"  reasons,  and  were 
therefore  dropped  from  further  analvsis. 

During  school  PAR  training  which  followed 
exposure  to  the  lab  system  by  about  14  weeks, 
the  subjects'  average  performance  was  equal  to 
the  school  average.  A product  moment  corre- 
lation was  computed  for  final  score  at  the 
school  vs  complexity  level  achieved  on  the  lab 
system.  The  positive  correlation  (R  = .78, 
p < .05)  indicates  that  better  performance  on 
the  lab  system  was  related  to  higher  scores  at 
the  school.  School  instructors  reported  bet- 
ter than  average  voicings  of  the  R/T  by  the 
subjects  exposed  to  the  lab  PAR  system. 
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The  (onclijsion  drawn  was  that  the  lab  PAR 
system  taught  skills  similar  to  those  required 
at  the  ATC  school  and,  further,  that  the  use 
of  computer  speech  recognition  can  be  combined 
with  advanced  automated  training  technology  to 
produce  an  automated  training  system  for  the 
PAR  portion  of  GCA  training.  Procurement  is 
undervay  for  an  experiment  prototype  system  to 
be  installed  and  evaluated  at  the  ATC  school 
itself. 

SUMMARY 

A system  was  described  which  provided  a 
laboratory  evaluation  of  the  feasibility  of  the 
use  of  computer  speech  recognition  in  training. 
Results  of  the  evaluation  indicate  that 
training  can  be  enhanced  and  manpower  costs 
reduced  by  a careful  integration  of  advanced 
training  technology  with  off-the-shelf  compu- 
ter speech  recognition  hardware  which  is 
enhanced  with  software  algorithms  designed  for 
a specific  vocabulary  set.  The  need  was  indi- 
cated for  further  research  and  development  via 
an  experimental  prototype  system  to  be  in- 
stalled a;,  the  Navy's  Air  Traffic  Control 
School . 
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ARS  TRACT 

A r.»  w t-ra  is  upon  us;  down  with  c‘oppt‘r 
win  t.iMt  prol  i feral  loTi  (Figure  1);  the  age 
>'t  . o.*l  htigi»t  opti-  al  rommunicat  ions  is  here. 
Frestiolv,  there  are  large  performance  advan- 
tages (band.width,  noise  imnuniiy,  signal 
at  l enu.it  it'n , si/e,  weight,  and  tot.il  electric.il 
isol.it  ion*  assoei.ited  with  fiber  «>ptics  data 
. <'romun i«  at  ions . In  the  very  near  future, 
there  will  also  be  cost  advantages. 


control  system  witli  l lie  following 
resu Its: 


WIRK  FIliKK  (H'lICS 


No.  of  Cables 
Total  lA'ngtfi 
Cable  & 

Connector  Weight 
Parts  Ct'st 


102 

4832  Ft . 

87  lbs. 
9.7  K 


1 1 

2f)0  Ft  . 

l.b  Ihs. 
I . I K 


This  paper  gives  an  introduction  to  fiber 
optics  and  shows  how  to  .apply  this  exciting 
r et  linoi  ogv  to  trainers  for  RKSOI/RCK  CONSKK- 
VATION  TllKOITdi  SIMCIATION. 


F I BK  K OPT  I C_  J ARiiON 

The  following  fiber  optic  terms  will  be 
used  throughout  the  paper: 


INikODCCTION 

In  recent  years,  fiber  optics  technology 
has  bei ome  a very  piomising  candidate  to 
repK.M*  metalln  wire  conductors.  The  stimuli 
for  this  advan<  ement  .ire  the  recent  reduction 
ol  signal  .ittenuation  of  fiber  optics  and 
the  rapid  advant es  in  semiconduc tor  light 
sources  and  photodetectors.  This  paper  will 
Introduce  fiber  optics  technology  and  describe 
ir. liner  applications. 

Recent  predictions  on  fif>er  optics  show 
that  they  will  provide  the  largest  growtfi  area 
in  electronics  since  the  integrated  circuit. 

It  is  hoped  tli.it  this  paper  will  serve  to 
stimul.ite  systems'  users  and  designers  to 
consider  the  potential  advantages  oi  fiber 
opt  Ir.s  and  to  evaluate  this  tei  hnology  as  it 
applies  to  tlu'lr  systems  requirements. 

The  following  <leve  I opment  s .ire  1. iking 
place  in  the  fiber  optit  field: 

1.  All  telephone  i nt e rsw i t i h i ng  center 
< ommunic at  ions  of  under  five  kilo- 
meters are  being  converted  to  tlber 
opt  1 ( s . 

2.  fable  TV  systems  in  I lie  U.S.,  Kngland, 
'a  rm.my,  .and  lapan  are  using  f iber 
opr  i c 8 . 

J.  The  Navy  ha.s  two  sfiip.s  at  s»*a  with 
fiber  optic  systems, 

4.  The  Navy  converted  and  flew  .in  A7K 
aircraft  with  liber  opt  fi  f i re 


1.  TYFICAL  F/0  _SYSTKM 

, FIBKK^  _ 

Kl.KCrr— H TRANS.  H— KKCKlVKHr^ 


A typiciil  fiber  optic  system  consists  ot 
tliree  elements: 

(a)  A transmitter  that  converts  the 
electrical  siRnals  into  li^ht  enerjty 
signals.  The  antenna  or  energy  pro- 
jection 'levice  Is  usually  .t  I.KD  or 
I.aser  Diode  (halliuni  Arsenide 
Technology ) . 

(b)  The  liber  light  guide  that  c.irries 
the  optical  energy. 

(c)  A receiver  that  .onverts  the  light 
energy  slgtial  into  ..  usetul  electri- 
cal signal.  The  detector  or  energy 
.ihsorpl  ion  device  is  usually  a FIN 
diode  or  Avalanche  detector  (silicon 
t echnol ogy ) . 

2.  KIHKK  CAKhF. 

The  principle  of  transmitting  light  etiorgy 
reiiulres  that  the  light  stay  within  the 
tiller  i.ible  (waveguide).  This  Is  accom- 
plished by  h.ivlng  the  index  ot  retr.u  tion 
dltlerent  between  the  center  and  outside 
ot  the  cable  (tot.il  Internal  reflection). 
When  the  Inside  I uh>‘  cont.ilns  one  indi'X 
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f IB£  R OPTICS 


COAX 


lOWCOSI  X 

300"  C T(  MPI  HATUHI  IC.l  ASSI 

VIHHATION  X 

lOWCHOSSIAlK  X 

NO  CROSS  TAI  K X 

Hfl  f Ml  NOISt  IMMUNf  X 

lOTAl  E LfCTRICAL  ISOLATION  X 

NO  SPARK  If  IRE  I X 

NO  SHORT  DISABLING  X 

NO  RINCiING  X 

1000‘’c  TE  MPT  RATURE  (GLASS) 

EMP  IMMUNE  X 

NO  CONTACT  UNRE  llABll  ITY  X 

signal  bandwidth  ) i gh/ 

POWE  H TRANSMISSION 


PRODUCTION  AND  SUPPORT  ENGINEERING 

NE  W TE  CHNOLOGY  X 

LOSS  IN  CONNECTIONS  AND  SPLICES  X 


X 

X 

X 

X 


>20  MH7 

X 

X 


nil  ar i soli  Gf  Cable  E’eatares 


E'lnure  3.  E'iber  iptic  Cable  ‘leleotioti  TradeofCs 
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.inti  is  Ktii  I oiimU’d  Iw  ojjtfi  t ulu  ol 
low*!  il!<il-X,  W«'  h.!VO  .!  illdi'X  tiluT. 

Mioii  t h*-  iniifX  v.»tl*'s  liiiiMtlv  t ri»m  t li* 
.onti’f  to  l hi‘  outer  i**l>*,o,  w*-  h.iv**  .1 
I •iiio'i  i ntiox  f j hcT . 

Thi-  li»l  lowing'  tljr«***  clussos  ut  r.iblo  .ii*- 
pr*‘Soul  Iv  l'*“Ui>'.  pfotitK  0(1  itMl.iv: 

[M.ASI  It: 


!*l.ASl  1( 

CLASS 

CLAD  Sir 

Lust 

I.0W 

High 

M**d  i urn 

Loss 

Mi  J-HigJi 

Low 

I>)W 

M.ind  1 i ng 

l.xce  1 lent 

Pool 

(iood 

Knv  i r • uinenl  a 1 

Poor 

(fOOti 

(rood 

1.  SINt.M  Kilir.R 

(>iu  sinv'lo  St  r. mil  ot  tiher  opt  ii  * »Mi' 
t-nt  losoi!  in  .1  pr*>t4ntive  juckotinp,.  liu* 
j.i*  k*-t  in^  is  only  lor  onv  i ronmon  t .1 1 pro- 
t««tii'n  sine*'  tin-  fiber  k**-j)s  the 
*‘iuT>’v  wholly  within  Its  structure. 

urNDl-K  FIKI^K 

A multiple  strand  tib**r  optic  cable  con- 
t. lining  (7,  l^,  »*te.)  fibers  eacli  carry- 
ing tile  same  liy.ht  **ner^;y  <>n(i  eriilosed 
within  a f)rote<tjve  j/jcket  ]n>j, 

5.  F!Hi.K  LOSS 

The  ami>unt  of  likljt  ener>'y  loss  in  liie 
fiber  cable  primarily  cause*l  bv  scalter- 
iiiR  and  absorption.  Cables  are  usually 
graded  Into  tliree  categories: 

I.ow  Loss  (<.10  dB/KM),  Medium  Lt>ss 
(10  dB<I.<100  dB/KM),  and  JliKb  boss 
( 100  dB<  I,<  1000  db  ^KM) 

6.  CONN KC'I  ( »K / SI* h K‘K  LO^S 

In  contrast  to  coax  systems,  every  con- 
nei  l ion /sp  1 i(  e causes  li^^'f  energy  loss 
primarily  tlue  to  misalignment,  reflec- 
tion, and  absorption.  Present  day 
connectors  introdtice  three  to  six  dH 
ot  loss  depending  *)n  whether  they  an- 
si>!>»l*-  libel  i^r  bundle  conni'C  I ors . 

Also,  eonni'ilor  availability  is 
V*ry  sus|>«'t  I at  lb*-  |>resent  time,  luit 
It  is  bound  to  improvi*.  !.aboratory 
splices  have  bei-n  ma<le  in  the  .1  to  ,2 
dB  range,  but  there  is  a gre.it  need  for 
field  rep'tlr  methods  and  equipment. 

7.  KKCKIVKK 

A reci'iver  cinult  aioepts  llglit  in  t lie 


10  to  100  rian(»w.it  t r.inge  and  pr'jdin  »-s 
I'll,  comp.it  ible  outputs  (O-'iV). 

H.  IKANSMI'I  IKK 

A transmitti  r * ircult  .i«(«‘pts  ni.  level 
input K and  prodiu  es  one  to  ten  milliwatts 
ot  light  pow«’r  out  ot  .in  I.hO. 

q.  "I"  CONNKCTOR 

Ibis  is  .1  p.issivi-  optical  t.ip  liiat  .illows 
energy  to  b**  extr.ict**d  from  .1  fiber  .>pti« 
*.ible  and  .illiws  optical  eru  rgv  to  f>e 
inl«T  jecled  into  the  fiber  >p*  ic  labl*- 
f r*)m  .1  rei  e i viT  / 1 r ansm  i l t el  (R/l)  port. 

iO.  KAOIAl.  ARM  COL’PhKH 

Ibis  is  a passive  opt  ic.il  device  tiiat 
.illows  the  light  imergv  from  **ne  fib*  r 
«M’t  ic  i-.ibli*  t"  be  riivi*ied  int.>  an  opti>.tl 
signal  on  many  fiber  cipt  ic  cables.  The 
following  two  types  of  r.idi.il  arm  couplers 
ari’  [>resenlly  in  use  today: 

a.  Kitleclive:  A n-flective  radial  arm 
coupIiT  cont.iins  a mixing  rod  .ind  a 
mirror.  Kvery  K/T  port  is  *-onnecteii 
to  the  c-ovipler  bv  cinly  one  fiber. 
Light  energy  eoming  from  one  R/ f into 
the  iimpler  is  nlUc  ted  b.ack  on  the 
fiber  cables  to  all  other  K/'I  ports. 

b.  Transmissive:  A transmissive  r.idi.il 
arm  coupler  cont.iins  »n  input  port 
ot  libers,  a mixing  r*)d , and  an  out- 
{)iit  poi  t *)l  fibers.  rill*  light  signal 
from  anv  R/l  is  thus  sent  to  all 
k/i’s  by  the  coupliT.  This  type  of 
r.idial  arm  coupler  is  the  simplest 

to  mecb.inize  -ind  presently  the  h'west 
In  eost . 


FIBER  cniC  AI)VANTA(;KS 

The  recent  .innouiu  **ment  s ot  liber  opt  iv- 
cable  TV  sysl**ms  in  New  York,  U'lulon,  .ind  Tokyo 
along  with  tile  iirst  operational  teleplione 
system  in  ('bicago  (Bell)  and  Long  Be.ich  (tiTE) 
should  eonvlnce  dmibiirs  lliai  tiber  optic 
technology  is  h»*re  to*lay. 

Why  should  oue  be  Interested  in  liber 
optics  systems  lor  IrainiTs.’  lb**  m.ijor  r*MS*uis 
are  bandwidth  and  noise  immunity. 

Figure  2 tabul.ites  the  cixnpar.it  i ve  fe.itures 
of  tiber  optlis,  and  coax.  K.icli  line  on  the 
i h.irt  endeavors  ii»  show  .1  f.ilr  compa r i st>n . K*>r 
low  cost,  the  comm*'!!  fa*'iors  are  the  same  c.ibl*' 
size,  flexibility,  equivalent  l>andwidtl),  and 
matui  fact  ur  Ing  qu.i  1 1 1 y . 


K i !)i'i  Dpt  i - Df  t o.ix  «> 1 1 4T  .i  1 .1 1 1 1 y «•  v«mi 
'h’irf  ill  t hf  lirsi  tout  c.i  t r ►'tir  i I's . It  otu- 
w.ints  .»  low  ^'losst.ilk  i*r  no  vrossf.ilk  (th.il  is, 
no  m*MsuT  .iM  «•  rrosst.ilk  hftW4‘»-n  .ntiotfiit  t Huts 
in  i til)»‘r  bnmtliO*  onr  woulil  w.int  to  tis**  t ibrr 
optics.  Siint*  tluTo  is  no  crosstalk 
•uij.jcent  tibiTS,  tluTo  is  n rtainlv  no  t ross- 
talk  botwotMi  aitpu'fnt  fiber  cabh's. 

Fiber  optii's,  bein^;  m.uir  ot  a dielectric, 
provides  ideal  KFI/KMI  noise  immunity.  They 
do  not  piikiip,  nor  do  they  radiate  any  si>'nal 
i nf  t)rm.it  ion . Fiber  optics  also  providi's  total 
eU»«lrlcal  isolation  between  tlie  sending,  and 
receiving  terminals,  eliminating;  any  common 
ground  and  the  problems  tb.it  are  associated 
with  I ommon  grounds  (voltage  offsets,  y,round 
currents,  >;round  noise,  pickup,  etc.).  I'here 
are  no  spark  or  fire  haz.irds  with  fiber  optics 
shi>tild  the  fiber  optics  be  damaged.  There  is 
no  local  second. iry  damav;e  incurred  because  no 
sparking;,  heat,  or  ilectrlcal  enernY  dissipa- 
tion of  any  sort  takes  place.  Iber*-  can  be 
n(^  short  circuits  or  c i rcii  i t - load  1 n^;  reflec- 
tions back  to  the  terminal  equipment  if  a fiber 
optic  c.il>le  should  be  damaged.  In  wire  systems, 
the  d.imav;e  to  a cable  may  cause  reflected 
dam.j«e  into  the  termin.il  circuits  by  short  in>;, 
►;roundin>;,  or  dangerous  p(>tentials  and  currents 
in  tlu*  vires.  The  fibers  do  not  conduct  elec- 
trical current  and,  thus,  eliminates  this 
prob I em . 

Fiber  optics  have  F.MF  immunity  for  tfie 
same  re.ison  — liiey  have  KFI/FuMI  Immunity.  Wire 
systems  suffer  from  ctuinector  d 1 sci^iU  inu  i t y 
problems  bet  aiise  of  the  need  for  ^ood  physical 
contact  connector  interfaces  tor  signal  trans- 
fer. Proper  polisbln>;  of  the  optical  Interface 
between  source  and  the  fiber  optic 

bundle  provides  a signal  ciuineclton  requiring, 
no  physical  contact.  The  ll^bt  energy  signal 
passes  through  the  small  air  ^;ap  between  the 
devices  arui  the  end  of  the  fiber  optic  bundle. 
CJrits  aruf  op.ique  materials,  howiver,  decrease 
transmission  or  dama>;e  connector  surfaces  it 
proper  procedures  are  ignored.  Temperatures 
.tip  to  l,00()^‘  C nuiy  bt*  wlthstotul  f>y  certain 
y.iass  systems.  Most  present  libers  are  stable 
well  bevond  JOO*'  C. 

Assumff)^  an  acceptable  fiber  loss  lactor 
in  the  ran^e  of  50  dB/km,  one  tinds  a 200 
meKaiiert?.  limit  with  fiber  opt  it  s tor  a 300 
meter  len^tth.  Coax,  according  to  handbook 
data.  Is  limited  to  20  megahertz  for  the  same 
cable  size  and  length,  and  a twisted  wire  pair 
Co  1 megahertz.  Fiber  optic  systems 
with  bandwidths  over  100  megahertz  should  be 
considered  laboratory  systems  at  present,  and 
not  quite  ready  for  deployment.  Potential 
sii^nal  bandwidth  with  single  mode  fibers  Is 
calculated  to  be  above  1 gigahertz. 


FIBF.K  OIM  IC  CAHI.K 

iln*  si'lf'tion  of  a fiber  optic  is  very 
important.  H»»wevfr.  one  is  immediately  t a<  ed 
witli  a number  ot  de<  islons,  < Iaims,  and  counter- 
ed.lims.  In  re.jJity,  t lie  application  will  drive 
the  selection  ot  tlu*  cable  used,  and  that  in 
turn  drives  tlie  selection  of  light  energy 
source's,  defcifors,  and  electronics.  Figure 
3 is  a t bre«-«l  imens  i ona  1 representation  of  the 
trade  offs  rccpiired  in  selecting  a fiber  optic 
( able. 


KI.KCTHONICS 

A rapid  evolution  is  taking  place*  in  the 
electronics  associated  with  fiber  optic  .systems. 
Up  to  today,  the  high  cost  of  fiber  optic  cable 
and  discrete*  component  designs  have  been  the 
driving  factors  in  system  sensitivity  analysis. 
Presently,  however,  we  are  in  the  second  step 
of  the  evolution  where  the  electronics  is  being 
packaged  In  liyhrid  and  monolithic  form.  Finally, 
we  will  see  tol.illy  integrated  sources,  detect- 
ors, and  all  electronics  in  one  IJIF  package. 
Figure  4 depicts  this  evolutionary  process. 

Fihei  optic  technology  is  thus  moving 
from  the  "scab  on"  (mounted  external  to  tlie 
existing  equipment)  to  the  equipment  design 
philoso{)hy.  To  be  cost  effective,  fiber  optics 
must  b<*  the  first  design  approach  and  not  a 
backup , 

TRAINKK  SYSTI->1  APPLl CATIONS 

if  we  look  at  a modern  trainer  like 
Honeywell’s  Sonar  Operator  Trainer  or  Device 
14E27,  we  see  two  areas  of  application  for 
fiber  optics. 

First,  we  need  intra-cabinet  "point-to- 
point"  data  links  (Figure  4).  Because  our 
systems  contain  totally  modular,  distributed, 
se  1 f-d iagnoseti , and  stand-above  cabinets;  the 
ground  isolation,  noise  immunity,  bandwidth, 
and  elimination  ot  copper  make  fiber  optics  a 
cost  effective  solution  today.  Imagine  a large 
digital  system  generating  sonar  waveforms  which 
are  to  be  converted  to  low-level  analog  signals. 
These  sign.ils  will  then  he  used  to  stimulate 
operational  sonar  h.irdware  at  the  low-level 
hydrophone  Inputs.  Also,  the  sonars  contain 
spectrum  analysis  equipment  whicli  are  very 
sensitive  to  coherent  noise.  Historically, 
ground  noise  in  a system  like  this  has  been 
a constant  source  of  tri>uble.  Fiber  optics 
conununicat  ions  has  no  common  or  gnmnd  return. 

A number  of  ways  have  been  discovered  for 
taking  advantage  of  the  fiber  optic  character- 
istics for  multiple  channel  ci>mmun  Icat  ions . 

As  we  now  know,  there  Is  no  measurable  cross- 
talk between  adjacent  fibers  In  a bundle,  and 
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thtis,  (ii>ssl.»lk  lufwH-rii  >*r»'tij»s  tibtTs. 
!})«•  fibrr  >’pt  i-  bun^llf  m.iv  thus  bt*  siibM  i v i tb*d 
ui(!»  i-.u  b >’.ri>Mp  «'l  til‘»-rs  bfinv;  .1  srp.ir.itr, 
p.ii.illfl,  tlumnt  !.  Ibis  roiu-i-pt  m.i%'  In- 

t«>  .»  siiu’.l*'  ptT  ib.jtinfl  it  i>tu- 

, i\\  .itt.'i  I i<-  'Ip  t h«-  t '•iluml.iMi  V in  .1 

,* T' Mjp  •:  t 1 b.  r . 


'i.-bf  -.'UT.  A-iib  litt.i'MU  v.iv  hn.-i  h 
. , r i.  f • : ; ' 1 » i • . 1 ] r ■.  r.  t-np  I ’V«  d f ■ > i l.) 

• ’ I ! 1 ip.i  i t V ' { ! . b«- 1 j t I ‘ . . Mil. 

! ' . i b ' ! . t r I i « I 1 ! • 'pu  I'l'  • ' '•  Ml  i » i p I »■  > in,’’ 

1 , ' - ^ •=«!».  n.iniu  - 1 ■ - • • bt  i!  ! i • il  'll  .1  t i : •■t 
M . . r'  , r »:  ! M-.-i  , .i  . v*  :.  -n  -it;,  !.- 

f J r . J ] ! r i J 11  * ;'I  • t I V it-,  -ut 

I i : Mm  i : i ■ ‘7.  V i 1 b 1 «■  r 'mI 

r : : hi  -M  II  ini  r u i*'i  MO'fA)  . 

. : . •.  :m  ill  t lit  • ••  "•••il  t i pi  *-x  i nr" 

!i:;ipM  . • I V bf  iin.'d  T-  '-nli.itM  « riritlv  r h« 
j.j  I i .ip.n  it.  I ! i bi  r ^pt  i • s . 


Tlu*  path  is  vtTV  i lmir  .ind  flbcT  optlis 
is  in  wid«-  usap.r.  TIht*-  is  I'lnuip.li  p«‘ r t ormatu  »7 
i ns  t /rn  V i ranmi-n  l .1 1 data  to  pi-rlorni  systnnis  .md 
prntlth  r St  nd  i rs  . 

As  'ai-  V i i-w  f hi*  1 1 'la  t i > n : 

I . (■'  I hr  r ■ i.s  t . V i J i Ic  ri-.i  -.t'  . f < (.Ml. 

Mnn-Milhi'  and  i nl  .-r  if  • il  tpli  al 
•■Ms  ir-mi  n.  lii!*--  .ii*-  in  1 b»-  pr  .i  i-  » 
ii-vi'l  ■p'^icni  -f  t.*-  Ill*:  Will  ir  vin  I 
.".t  V .t  I T;  .. 

. . K i tM- r ■ »p(  1 1 Will  I . -din  * t In*  • - st  : 
triiiuT  s'.*iti-ns  by  ill-iwin,'  widi-r 
bamj  lata  t r ansn- i ss  i i m with  t -tal 
• ' t * r 1 - 1 '1  .V.  i:  • n;:  i t v . 


. snd,  A*  Uffd  rmllipW*Xi'd  data  b'issi-s 
*.  'r  r i'  r 'ipi  » s*-' ■ r basnd  distribui«-d  svstnms 
th.it  .iM'  bi'inp  dnvnlnped  today.  Kibi  t opt  it 
vi.it. I bus  dt'Vi*  lopnmnl  s arn  thn  bippa'sl  KiiD 
.irias  ti'dav.  Fi>;urv  b slu>ws  tbi*  "1"  and  "st.ir" 
d.ita  bus  i.  I’lU  i ^urat  inns  bi'in^  di-vt*  1 1'pnd  tiid.iy. 
The  "f"  syst«*m  is  t Ik*  nnst  likt*  <1  cnax  systnm, 
but  it  b.is  two  m.ijor  drawbacks:  First,  a 
passivi-  system  sustains  so  much  loss  per  pnrf 
that  eight  taps  is  abmit  maximum;  and  seennd, 
il  repeaters  are  placed  .it  the  taps  to  over- 
came signal  loss,  the  system  reliability  is 
reduced  s i gn i t i can I I y . 

Tile  "star"  uses  a radial  arm  coupler  which 
is  being  developed  by  many  companies  today. 

This  concept  requires  low-Cosl  fiber  and  low 
signal  loss  itinnectors.  Both  requirements  are 
becoming  facts  today.  In  the  next  few  years, 
we  will  see  this  type  of  data  bus  predominate 
because  it  overcomes  the  problems  associated 
with  the  "T"  coupler. 
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S TU  D K N T I>  i:  RFO  RM ANCF 
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Akron,  Ohio 


SUMMARY 

Simulators,  or  trainers,  have 
been  available  foi  years.  These  de- 
vices have  developed  from  inqonious 
mechanical  qear  , to  eli'Ct  r ica  1 -ana  loq 
controlled  equipment,  to  the  present 
sophisticated,  digital  computer-con- 
trolled designs  ol  today.  Simulators 
now  exist  that  help  train  personnel 
to  oper.ite  virtually  any  mechanism 
invented.  These  include  ships,  air- 
pl.ines,  trains,  automobiles,  orbit- 
ing vehicles,  advanced  r.idar  , etc. 

Much  effort  has  been  expended  in  de- 
fining .ind  refining  trainer  hardware 
and  software  to  develop  a simulator 
of  ijreater  and  greater  fidelity  to 
the  performance  of  real-life  equip- 
ment. This  is  only  fittimj  and  has 
resulted  in  succeeding  generations  of 
simulators  performing  in  increasingly 
compatible  performance  to  their  mod- 
els. The  F-15  simulator,  itself,  is 
a technical  marvel  in  synthesizing 
the  character istics  and  capabilities 
of  this  high-performance  jet  aircraft. 

However , perhaps  because  of 
American  industry's  strides  in  per- 
fecting the  performance  of  simula- 
tors, greater  attention  has  now  fo- 
cused on  training  methods  and  student 
performance  evaluation.  On  earlier 
trainers,  the  progress  and  final  tes- 
ting of  students  has  been  influenced 
by  subjective  ratings  of  the  instruc- 
tor . 

Certain  specific  skills  obvious- 
ly must  be  learned  by  students  to  bo 
able  to  "fly"  an  aircraft  simulator 
from  airfield  "A"  to  point  "H"  and 
return.  Otherwise  the  student  may  1) 
crash,  2)  lost?  his  way,  3)  jjerform 
otherwise  noticeably  erratically,  and 
would  be  relieved  of  his  student  clas- 
sification. While  very  objective 
tests  or  problems  thus  eliminated  the 
ineffective  pilots,  the  instructor- 
pilot  (IF)  was  left  with  the  now  for- 
midable and  <ju i te-sub  ject  i ve  evalua- 
tion of  the  relative  performance  of 
the  remaining  "good"  pilots.  The  IP's 
judgement  now  had  to  overcome  the 
"tog  factor"  of  his  own  preferences 
.md  prejudices  of  what  constitutes 
good  flying,  his  own  alertness  during 
all  parts  of  each  student's  test 
fligiit,  his  personal  attitude  toward 


individual  students,  etc.  Then, 
pitting  these  low-control  factors 
against  other  instructor's  rlifferent 
prejudices,  beliefs  and  personali- 
ties limited  consistent,  relative 
rating  of  students'  abilities  and 
progress . 

Thus,  the  recent  stress  on  more 
impersonal,  comprehensive,  and  uni- 
form evaluation  of  students'  pro- 
gress and  final  performance  is  cer- 
tainly warranted.  The  benefits  from 
any  objective  or  "third  party"  tost 
of  students'  performance  are  not  on- 
ly that  uniform  and  fair  testing  re- 
sults, but  that  oven  the  training 
provided  by  the  instructors  becomes 
tailored  to  the  common  denominator 
(perhaps  oven  improving  some  areas 
of  teaching).  The  IP's  will  con- 
sciously or  otherwise  teach  their 
students  so  they  can  score  well  on 
the  tests  they  know  will  follow. 

The  scoring  methods  evolved 
during  the  development  of  the  F-15 
simulator  include  methods  to  eval- 
uate student's  flight  and  tactical 
performance.  Flight  scoring  covers 
the  ability  of  the  student  to  cor- 
rectly fly  approaches  to  or  depar- 
tures froni  selected  airfields.  Tac- 
tics scoring  involves  the  evaluation 
of  the  student's  techniques  and  suc- 
cess in  releasing  weapons  at  ground 
or  airborne  targets  encountered  ran- 
domly during  a simulated  mission. 

Fig.  1 is  a schem.itic  diagram, 
showing  the  basic  elements  of  the 
monitor-scoring  sequence.  liefore 
flight,  and  for  a large  number  of 
airfields,  data  for  the  plan  and 
elevation  view  for  a CRT  display  of 
approach  or  departure  plates  were 
entered  on  disc  with  "MOD  SUPPORT" 
programs.  This  allows  the  IP  to  se- 
lect one  of  • library  of  approaches 
or  departurf.v;  be  displayed  on  a 
large  CRT  fi  ..ubsoquent  flight  by 
the  student  and  scoring  at  the 
end  of  the  mission.  Before  flight, 
the  approach  or  departure  is  seg- 
mented into  separate  legs.  These 
arc  also  entered  on  disc  files  asso- 
ciated with  the  CRT  data  for  the  air- 
field picture  using  ".MOD  SUPPORT." 
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Adii  1 1 1 ' itKi  1 liooii!!'!  I(-'q  d.it.i  plac't'd  on 
this  disc  tilt'  includes  the  VMti.ibles 
te  be  monitored  durinq  e.ich  loi),  the 
\Mi  i.il  les  which  lietine  the  end  ot  e.ich 
lei,  the  tolerunces  to  which  Ihesi' 
v. lilies  must  be  met,  time  delay  on 
scc'i  1 n>j  any  leq  , etc.  Durimj  the  mis- 
sion, the  ir  may  call  up  any  one  of 
the  stored  airfield  plates  onto  a dis- 
; 1 ay  CUT.  A number  of  tlicjht  para- 
it;etei  s are  saved  once  [ler  second  when 
till-  student  flies  within  a 20  nm  cir- 
cle arourul  the  field.  The  instructor 
may  watch  th»'  real-time  progress  of 
the  1'- 1 5 by  observin'"  various  flight 
parameters  such  as  sp-^ed , altitude, 
headinij,  pitch,  eneiee  KI’.M , etc.  on 
the  center  CRT  while  .i  "bug"  repre- 
senting the  l'-15  positi  n,  one  on  the 
airfield  jilate  plan  view  and  another 
on  th-'  side  view,  are  flying  to  scale 
on  the  right  hand  CRT.  After  the  mis- 
sion IS  complete,  the  instructor  may 
score  the  student's  approach  or  de- 
parture for  as  many  as  five  fields 
flown  during  the  mission.  The  student 
is  graded  100  with  deductions  propor- 
tional to  time  and  magnitude  of  flight 
error  compared  to  the  prescribed  ap- 
proach or  departure.  The  airfield 
name,  approach  or  departure  name  and 
the  student's  score  are  displayed  on 
the  center  display  tube.  Also  shown 
are  each  error  event  and  detail  data 
of  what  parameter,  when,  how  much,  and 
how  long  it  occurred.  Separate  scores 
are  calculated  for  each  scored  ap- 
pro.ich  or  departure.  If  desired,  the 
1 R may  make  a hard  copy  of  the  CRT- 
displ.iyed  scoring  pages.  These  can  be 
KR/iTOS  (copy  of  the  CRT),  TTY,  or  line 
printer  (available  at  Luke  Af'B  only). 
Finally,  the  11’  may  elect  to  have  a 
hard  copy  of  all  the  flight  data 

s. ivi'd  in  core  for  any  or  all  the 
scored  approaches  or  departures. 

Tactical  monitoring  and  subse- 
'juent  scoring  may  be  performed  on  the 
S'lme  or  separate  mission  as  flight 
scoring.  Prior  to  the  mission  the  IP 
may  elect  to  have  up  to  15  emitter- 

t. irgets  (RT's)  come  into  radar  view 

.lutoma t ica  1 ly  during  the  mission.  He 
would  use  "MOL)  SUPPORT"  to  set  up  the 
type  (ground,  airborne,  emitter,  emit- 
ter- t.irget  ) , location  (for  ground  tar- 
get), range,  bearing,  altitude  and 
path  (for  airborne  targets) . During 
fliijht,  the  IP  could  let  these  KT ' s 
appear  at  predetermined  times  as 
planned,  or  could  override  .ind  enter 

new  targets  as  he  saw  tit.  The  stu- 
dent must  then  take  positive  .iction  to 
report  the  KT  vi,i  radio,  .ichieve  r.id.ir 
lock  ori , and  finally  select  the  ap- 
propriate wiMpon  .uid  release  it  at  the 


target  . This  data  is  saved  .it  time 
of  wi'apon  release  .ilong  wit.li  other 
pertinent  d.it.i  d('pendin<j  on  the?  mode 
of  at  t.ick  (,i  1 r-to-a  1 r , ,iir-to- 
ground),  <ind  displayed  along  witii 
the  "hit  or  miss"  calculatirin  leased 
on  KT  path  .ind  weapon  t ra  jector  if’s 
or  on  KT-firing  envelope  for  cert.jin 
we.ipons.  Pinal  ly,  an  average  score 
for  the  releasi'  (at  scored  KT's)  of 
all  weapons  utilized  during  the  mis- 
sion is  calculated  b.ised  on  four  for 
an  KT  "kill"  and  zero  for  an  KT 
"miss."  During  this  tactical  exer- 
cise, the  student  is  allowed  only 
one  weapon  release  (this  includes 
one  release  for  a "stick"  mode  drop 
of  several  bombs  or  one  release  for 
a single  trigger  pull  on  cannon  fire 
for  <is  many  individual  rounds  that 
are  fired  during  that  trigger  pull). 

After  the  mission  the  IP  may 
score  the  tactics  performance.  The 
center  CRT  will  then  display  the  KT 
number,  the  hit  or  miss  code  (PK  of 
1 or  0)  and  other  pertinent  data  de- 
pending on  the  attack  mode  for  each 
KT.  Hard  copy  of  this  display  can 
also  be  made  as  for  the  flight 
scoring  pages. 


THK  SIMULATOR 

Goodyear  Aerospace  developed 
the  P-15  simulator  under  Contract 
No.  P 3 3657-7 3-C-0701  from  the 
McDonnell  Douglas  Corporation,  St. 
Louis,  .Missouri.  Fig.  2 is  a 
sketch  of  system  hardware  approxi- 
mately in  final  conf igura tion . 

The  major  simulator  components 
include : 

1.  Cockpit  section,  GAC , with  full 
instrumentation,  controls,  and 
sounds.  A coated  canopy  for 
instrument  flying  is  currently 
supplied . 

2.  Motion  platform,  CAE  Elec- 
tronics, Ltd.,  Intermediate  6- 
Degreos  of  Proedom  Motion  Sys- 
tem; vertical,  lateral  and 
longitudinal  movement  of  60", 
60",  and  40"  respectively; 
pitch,  roll,  and  yaw  of  40°, 

40°,  and  30°  respectively,-  load 
capability  includes  personnel 
cockpit,  .ind  consoles  plus  8000 
pounds  (for  <i  future  visual 
system) . 

1.  Computers  (three),  Harris  Mfg. 
Co.,  Model  6024/4  minicomputers. 
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()4  0 00  (J4-l>il)  words  each,  .75 
usee  per  cycle. 

4.  Moviivi  head  disc,  Information 
htora'ie  hystem,  Inc.,  Mfidel  7140 
Disk,  28  meqaby  t I's , 12  to  100 
millisecond  retrieval  time. 

5.  I'.ipor  t>ipe  unit: 

a.  Punch,  Teletype  Corp., 

(BRl’K)  Model  600  1,  punches 
5,  f)  , 7,  8 level  tapes  at 
110  characters  per  second. 

1).  Reader,  Diqitronics  Corp., 
Model  6002,  roads  300  cti.ir- 
acters  per  second  (jihoto- 
electric) . 

c.  Handler,  Ditj  1 1 ron  i cs  , Model 
6040,  paper  tape  haruiler. 

6.  l.lectrical  equipment  racks,  GAC , 
power  supplies,  switches,  break- 
ers, A-0  iind  D-A  convertors,  etc. 

7.  Instructor  console,  GAC,  three 
CRT  display  tubes  (Adaqe,  Model 
420  Graphics  Display),  system 
controls  tor  display  and  F-15 
cockpit  interaction,  annunciator 
and  intercom,  sound  level  con- 
trols, Kratos  Model  7000  Graph- 
ics Hard  Copier,  Teletype  R035 
Teletype  Printer,  TKC  Model  440, 

A1 phanumberic  Display  Unit. 

8.  Diqital  Readout  Unit,  Goodyear 
Aerospace  Corp.,  Model  URU , will 
display  octal,  scaled  fixed  point 
or  floatinq  point  values  of  any 
register  or  address  during  execu- 
tion. It  operates  in  STOP,  HALT, 
TRAP,  or  RUN  mode  to  control  t(ie 
computer.  It  can  display  con- 
tents of  a register  or  address 
each  time  a TRAP  address  is  ref- 
erenced. It  IS  used  for  mainte- 
nance and  test. 

9.  Maintenance  and  equipment  room 
w)iich  will  store  necessary  sup- 
plies and  maintenance  equipment 
and  provide  soundproof  conceal- 
ment for  the  following  equipment. 

a.  Hydraulic  pump  unit,  Vickers 
Div.  of  Sperry  Rand  of  Canada, 
Ltd.,  3-50  HP  and  1-5  HP 
motor  for  hydraulic  pumps 
with  controls,  tanks,  etc. 

b.  Air  compressor,  Gast , for 
pressure  to  anti-q  suit. 


c.  Water  pump  ami  water  cooler 
uni ts . 

Willie  considerable  project  in- 
siqiit  and  direction  during  the  de- 
velopment c.ime  from  the  contractor, 
McDonnell  Douglas,  much  of  the  con- 
ce))tual  effort  came  from  the  United 
States  Air  Force.  Air  Force  [per- 
sonnel from  the  F-15  System  Progr.im 
Office  (SPO) , the  Aeronautical  Sys- 
tems Division  (ASD) , both  from 
Wr  i (jh  t- Pa  t ter  son  Air  F’orco  Base, 
Dayton,  Ohio,  and  Tactical  Air  Com- 
mand (TAC)  from  bases  around  the 
United  States  met  with  McDonnell  and 
Goodyear  technical  and  contractual 
[personnel  at  three  detailed  meetimjs. 
These  were  the  Preliminary  Design 
Review  (PDR) , Critical  Design  Re- 
view (CDR) , and  the  Critical  Design 
Conference  (CDC) . At  these  mootings 
specification  points  were  reviewed 
and  clarified;  design  and  hardware 
conco[Pts  from  overall  philoso[phy 
down  to  detail  operational  data  were 
modified  and  a[)proved;  and  final  de- 
sign and  assomlply  proceeded. 

After  assembly  of  the  first 
unit  at  GAC,  both  McDonnell  and  the 
Air  Force,  se[)arately,  conducted 
perhaps  the  most  comprehensive  ac- 
ceptance tests  imposed  on  an  air- 
craft simulator  to  date.  Fvory  ma- 
jor subsystem,  aerodynamics,  propul- 
sion, radar,  central  (on-board)  com- 
puter, etc.  was  cjiven  detail  per- 
formance evaluations  to  Acceptance 
Test  Procedures  (ATP's)  that  were 
prepared  by  specialists  in  that  area 
from  McDonnell  engineering.  Those 
tests  were  reverified  by  the  Air 
Force . 

Tlie  completed  simulator  can 
navigate  v.'orldwide.  It  can  carry 
the  full  (and  variable)  armament 
load  of  the  F-15.  It  can  release 
those  wea[Pons  at  a library  of  ground 
or  airborne  emitter-targets  (ET's) 
that  may  emit  electromagnetic  radia- 
tion as  desired.  Radar  and  asso- 
ciated ANMI  display  are  true-life 
functional  to  provide  the  target 
visibility  for  tactical  operations. 

A fully-simulated  Heads  Up  Display 
(HUD)  is  provided.  Sound,  motion 
(including  details  such  as  tar- 
strip  impacts  while  on  the  runway) 
and  motion  cues  are  provided.  On 
board  computer,  of  the  IBM,  4-PI 
family  (8K,  32-bit  words)  is  sim- 
ulated for  navigation  calculations, 
HSI,and  ADI  control;  to  provide 
range  and  lead  calculations  for  gun's, 
bombs  and  missiles  in  attack  mode. 
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The  instructor  c.in  initiuti'  mult  unc- 
tions from  u I2'j-s<-t  libiury  uni  ob- 
scivo  student  collective  action.  The 
tliri'i'  CHT's  allow  mmI-  timi’  observa- 
tion of  (on  the  left  ) cockpit  tadar 
tnd  A.’.'MJ  (ii.spl.jys  and  navi  <ja  t ion  aids, 
1 IT  , A/ll,  and  communications  panels, 
(on  thi'  ci'iiter)  the  HUD  (pitch,  roll, 
headina,  speed. and  altitude)  and  a 
numliet  of  othi'r  1 1 icjht  and  enqine  var- 
iables, and  (on  the  riqht)  the  initial 
position  paqes , approach  plates,  ID- 
display,  malfunctions,  radio  station 
paqes,  tactical  ( UT  intrusion)  sets, 
store.s  iveapons  con  f i >rura  t ions  , envir- 
onnient  , etc.  Most  "library"  data  can 
be  chaiKjed  to  suit  new  or  different 
areas  and  circumstances  witti  "MODllT- 
CATIO.N  S(;IM’ORT"-prompted  cues  on  the 
TKC  440  for  teletypi’  response  by  an 
operator . 

To  capsul  i ?.c--tho  I'-IO  may  navi- 
aate  worldwide,  fly  into  almost  all 
fliqht  or  tactical  real-world  situa- 
tions with  a variable  load  of  stores 
and  weapons.  Many  true  einorqencies 
!Tiay  b(.‘  simulated  arid  finally  a compre- 
hensive fliqlit  and  tactics  scorinq 
capability  is  provided. 


PLIGHT  MON 1 TORINO 

To  monitor  or  save  data  tor 
scorinq,  the  IP  must  first  select  tlie 
desired  approach  or  departure  field 
from  the  library.  This  "plate"  is 
displayed  on  the  riqht  hand  CRT.  If 
the  student  is  within  the  20  nm  circle 
around  the  airfield,  a set  of  twenty- 
two  variables  is  saved  each  second. 
These  variables  are  shown  in  Table  1. 


of  f 1 iqtit . 

Up  to  five  approaches  or  di-par- 
tures  (in  any  mix)  for  wliicli  af^- 
proacli  or  departure  plates  exist,  '-.ip 
be  monitored  and  scored.  Provision 
IS  m.ide  for  90  such  plates.  They 
can  lie  ciianqc'd  to  different  iir- 
fi'Tds  or  sir, ply  modified  by  an  in- 
teractive display  oii  the  TKC  440 
display  unit  (controlled  iiy  "MoU 
SUPI'ORT"  pro'jrams)  ,in<i  the  minually- 
oper.ited  R035  teletype. 

I-'or  a departure , the  IP  must 
Select  the  di.'parture  plate  t'.r  that, 
airfield  before  the  student  becores 
airborne  on  his  takeoff.  otherwis'-, 
ttie  subsequent,  off-line  scorinq 
proqram  would  "lose"  the  F-15  and  a 
poor  score  would  result.  Departure 
data  is  saved  until  the  F-IO  exits 
the  20  nm  circle  or  1200  secfinds  of 
data  has  been  loqqeti . 

However,  if  the  IP  selects  a 
different  approach  or  dcqiarturi' 
plate  while  the  student  is  still 
within  the  20  nm  circle,  monitor inq 
of  that  fliqht  will  terminate  imme- 
diately. This  departure  (or  ap- 
proach) will  count  as  one  of  t)ic 
five  scored  fliqhts.  Later  scorinq 
will  be  performed  on  this  fliqht  up 
to  tlie  point  of  termination. 

Willie  fly  inq  a scored  flitilit 
pattern.  Die  IP  may  elect  to  obsi'rvo 
tlie  fliqlit  path  of  the  P-15  marker 
on  the  riqlit  li.ind  CRT  display  of  the 
approacli  or  dc'parture  plate.  If  ho 
wishes  lie  may  replace  this  scene 
with  other  paqe'S  (except  not 


TABU  ).  I'LlliHr  DATA  BUUER 


1 . 

speed 

9 

2. 

altitude 

10 

3. 

head i nq 

1 1 

4 . 

climb  rate 

12 

5. 

turn  rate 

1 3 

6 . 

anqle  of  attack 

14 

7 . 

roll  anqle 

15 

8. 

qlide  slope  dev. 

16 

loc.ilizer  deviation 
tacan  radial 
t aean  distance 
tai.-an  channel 
P-15  conf iqurat ion 
P-15  in  MM  beacon 
lat i tude 
lonq i t ude 


17. 

qross  weiqht 

18. 

airborne  flaq 

19. 

problem  time 

20. 

nm  to  ^ of  circle 

21  . 

F-15  1 n OM  beacon 

22. 

t'lid  of  f 1 i aht 

The  data  saved  each  second  is 
packed  "on-line"  into  two  5-second 
buffers.  As  each  buffer  is  filltvl, 
it  is  transferred  to  drsc  storaqe 
(disc  file,  PLTPIL,  in  Piq.  1,  p.2). 
Each  area  reserved  for  a sinrle, 
scored  flight  is  240  sectors  lonq  and 
can  store  data  for  about  80  nm  at  an 
avfcraqe  speed  of  about  250  knots,  or 
a total  of  20  minutes  (1200  seconds) 


anotlier  app/dep  plate)  and  continue 
savinq  data.  He  may,  for  instance, 
select  a m<il  function  paqo  . He 
could  then  insert  one  or  more  mal- 
functions into  tlie  P-15  while  still 
mom  tor  inq  performance  to  tile  ori- 
qinal  appro.icli  plate.  Reselection 
ol  the  same  plate  would  tlion  allow 
the  IP  to  continue  observinq  the 
P-15  [iroqres.s  on  the  plate. 


Trim  1 n.if  ion  of  <i  ;>cor'-ci  f 1 i(jht. 

• il.so  occurs  il  t hr  student  crushes, 
rcoiinu  conti  nut's  tip  to  thut  point. 

It  the  IP  selects  un  upprouch 
{ u.je  to  un  uirtield  from  which  t lie 
P-15  IS  out.sitie  the  20  nm  riti'i,  the 
t 1 itiht  dutu  will  be  monitoreti  from 
the  time  the  uircruft  entt'rs  tht'  rinfj 
unt 1 : 

1.  Truchdown  in  normul  luiuiiiuj. 

2.  Wheels  .ire  retructed  .liter  huvinij 
once  been  extended. 

1.  The  uircr.ift  pusses  the  normul 
I L.S  touchdown  point. 

A new  .ippro.ich  r.uy  be  monitored  on 
■mother  selected  uirfiebi,  or  on  the 
s.imr  uirfieid  (if  this  uirfiold  is 
still  the  selected  plute)  if: 

1.  The  l<indin<i  tjour  is  rolowered 
witiiin  the  20  nm  circle  and  the 
I LS  localizer  brum  is  reentered 
at  or  near  normul  intercept  und 
altitude  locution. 

2.  The  P-15  exits  und  reenters  the 
20  nm  circle,  requrdless  of  con- 
f I'lui  ution . 

t pon  penetratinu  the  20  nm  circle  on 
in  .ipprouch,  the  student  must  p'roceed 
directl'/  with  the  upprouch  instruc- 
tions. He  may  not  enter  a holding 
p.ittern  partly  or  wholl'y  within  tin.' 

20  nri  r.idial  or  the  off-line  scoring 
progr.ir.s  would  be  un.ible  to  truck  the 
P-15  to  touchdown  und  .m  undeserved 
poor  score  would  result. 


TAi'T  I CS  MOh  I TOR  I .NG 

If  the  IP  initiates  tactics 
scoring  und  activates  un  emitter- 
target  (KT)  or  a preselected  group 
of  HT's,  a set  of  data  will  bo  stored 
in  memory  when  the  student  aims  and 
I'  leuses  .1  weapon  at  the  PT . The  ac- 
ta.il  data  displayed  varies  with  the 
• itt.ick  mode  ( a i r- to-.i  i r , air-to- 
ground  [ex.  CUIP),  a 1 r-to-ijround 
ICDIPl).  This  data  relateii  to  mode 
IS  shewn  in  the  scoring  section  below. 
Table  2 shi'WS  the  total  set  of  data 
locations  .ivail.ible  for  stor.ige  after 
weapon  r>;  lease.  D.ita  for  a total  of 
15  teleises  c.in  bi:  saved  duriiuj  .i  sin- 
gle i-roblei:  or  mission.  The  trainer 
Can  monitor  flight  .ind  tactics  during 
th>-  s.im<-  problem. 


Whi  le  the  st  udent  may  aim  and 
fire  only  one  weapon  at  any  KT,  one 
release  may  include  more  than  one 
projectile.  Por  instance,  a single 
release  m.iy  inclutio; 

1.  A single  missile. 

2.  A simultaneous  drop  of  several 

bombs . 

3.  A "stick"  drop  of  "n"  bombs. 

4.  A burst  of  cannon  fire. 

5.  A cr.ish  while  the  KT  is  active. 

6.  The  IP  killint)  the  P-15. 

'I’he  latter  two  cases  are,  of 
course,  not  true  releases,  but  are 
each  counted  as  one  of  the  15 
allowed  releases.  The  only  dat.a 
available  for  those  releases  is  the 
KT  number,  the  v.ariable,  MISSION' 
SUCCESS,  (.MI  2 for  crash  and  .MI  3 
for  instructor  termination) , and 
probability  of  kill  of  "0.''  The 
balance  of  the  data  is  starred  (***) 
on  the  scoring  display.  All  data 
saved  for  the  releases  is  stored  in 
core  for  use  at  problem  end  for  the 
off-line  scoring  program. 

In  the  case  of  a drop  of  multi- 
ple bombs  on  manual  or  automatic 
aim,  monitoring  terminates  for  that 
KT  us  soon  as  one  of  the  weapons 
scores  a kill.  The  balance  of  the 
weapons  are  released  but  scoring 
will  bo  based  only  on  the  "killing" 
bomb.  Kven  on  a miss,  only  one 
score  will  be  counted  for  this  mul- 
tiple drop,  and  it  will  be  based  on 
the  closest  impact  to  the  target. 

To  assist  in  positive  training, 
the  KT  will  disappe.ir  from  HUD  a. id 
radar  screen  immediately  if  a "kill" 
is  made  (PK  1) . The  KT  is  leit  on 
the  CRT  display  after  a "miss."  No 
otlier  active,  scored  KT ' s are 
allowed  in  view  during  scoring  an 
KT . Only  one  scored  KT  m.iy  be 
on  the  screen  at  any  Lime. 

Actu.il  "kill"  or  "miss"  calcu- 
lations vary  with  the  type  of  weapon 
rele.istd.  IP  wi-apons  ri'guire  detor- 
mini'_ion  of  "in-riUigi-"  and  suffi- 
cient received  IR  power  for  kill. 
Long  and  sliort  range  missiles  rc‘- 
guiri'  references  to  " launch  enve- 
lope" to  assess  a kill.  Whili'  tor 
gun  rounds  .ind  bombs,  actual 
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TABLE  2.  TACTICS  DATA  BUFFER 


1. 

score  mode 

9. 

angle  off  to  ET 

17. 

true  airspeed 

2. 

ET  number 

10. 

G-force 

18. 

roll  angle 

3. 

radar  acquis,  time 

11. 

ET  altitude 

19. 

miss  distance  to  ET 

4 . 

UHF  call-in  time 

12. 

ET  heading 

20. 

impact  bearing  to  ET 

5. 

weapon  launch  time 

13. 

ET  ground  speed 

21. 

ambient  air  temp 

6. 

mach  number 

14. 

probability  of  kill 

22. 

ambient  air  temp 

7. 

altitude 

15. 

mission  success 

23. 

ET  vertical  speed 

8. 

slant  range  to  ET 

16. 

pitch  angle 

24. 

aim  point  error 

ballistic  trajectory  is  calculated  to 
determine  intercept  with  a moving  (or 
stationary)  ET. 

Some  of  the  parameters  shown  in 
Table  2 require  additional  descrip- 
tion • 

1.  Miss  distance  (See  Fig.  3). 

This  is  the  distance  of  impact 
of  a bomb  from  a ground  target. 

2.  Impact  bearing  (See  Fig.  3). 

This  is  the  angle  from  F-15 
heading  of  the  line  from  impact 
to  target. 

3.  Angle  off  (See  Fig.  4).  This  is 
the  absolute  angle  between  the 
line  extending  aft  through  the 
longitudinal  axis  of  the  ET  and 
the  line  drawn  from  the  F-15  to 
the  ET.  It  iaay  vary  from  0 to 
180°. 

4.  Aim  point  error  (See  Fig.  5). 

This  is  the  effective  ground 
separation  of  aim  point  to  tar- 
get as  measured  by  the  distance 
between  the  HUD  reticle  and  the 
target  designator  on  the  HUD  dis- 
play. 

5.  "Stick"  or  "ripple"  mode  release 
(See  Fig.  6).  This  sketch  shows 
a 5-weapon  stick  and  the  A or 
impact  bearing  that  would  show 
on  a subsequent  scoring  display. 

SCORING 

Flight  - Before  flying  an  ap- 
proach or  departure  for  later 
scoring,  data  for  the  CRT  display  and 
the  scoring  legs  roust  first  be  keyed 
into  disc  memory  (See  Fig.  1).  There 
is  space  for  ninety  plates.  Data  for 
a large  number  of  CRT  displays  (77) 
for  various  approaches  or  departures 
were  keyed  in  during  first-unit  clieck- 
out.  These  are  entered  via  tlic  MOD 
SUPPORT  mode.  The  TEC  440  CRT 
prompts  the  IP  (or  other  technical 
personnel)  for  the  necessary  inputs 


which  he  then  keys  in  on  the  R035 
teletype.  The  scoring  legs  for  a 
plate  are  similarly  keyed  in,  aided 
by  automatic  prompts  on  the  TEC  440. 
Fig.  7 is  a FLIP  CHART  (High  Alti- 
tude Instrument  Approach  Procedures) 
page  showing  the  HI-TACAN  RWY  33  ap- 
proach to  Holloman  Air  Force  Base 
airfield.  The  circled  numbers  along 
the  flight  path  were  added  by  the 
author  to  show  the  seven  flight  sec- 
tions or  "legs"  into  which  this  ap- 
proach is  separated  for  the  scoring 
leg  table.  A brief,  descriptive 
outline  of  the  table  that  was  keyed 
in  for  the  scoring  legs  on  this  ap- 
proach is  shown  in  Table  3.  The 
table  shows  seven  legs  for  this  ap- 
proach. For  instance,  the  fifth 
leg  shows  three  variables  monitored, 
RADIAL  @ 52"  +3°,  SPDLEG  which  sig- 
nifies that  tHe  F-15  must  fly  the 
handbook  curve  of  Approach  Speed 
vs  Gross  Weight  within  + 5 knots, 
and  AOA  (Angle  of  Attach)  of  21  + 1 
unit.  The  transition  point  or  end 
of  this  leg  is  reached  at  2.8  + .2 
or  3 DME. 

Table  4 shows  fifteen  variables 
that  may  be  selected  to  either  be 
monitored  (3  max.  to  any  single  leg) 
or  to  be  set  for  the  leg  transition 
point.  The  IP  will  use  these  three- 
letter  variable  names  when  building 
or  modifying  approach  o”  departure 
scoring  legs  for  the  "approach 
plates."  The  interactive  prompting, 
for  instance  would  request, 
"MONITOR."  The  IP  would  then  key 
"RAD"  and  a nominal  value  "152" 
tolerance  of  "+3"  for  leg  1,  etc. 

Flight  scoring  maximums: 


No.  of  legs  16 
No.  monitored  variables/log  3 
No.  variables  to  end  a leg  2 
No.  of  tolerance  typos  2 


The  tolerance  types  include  the 
usual  t to  a nominal  value  and  + 

( ) , -0  as  at  leg  4 of  Fig.  7 when 
altitude  of  the  aircraft  must  be 
5500'  + 50,  - 0. 


188 


Figure  5.  Aim  Point  Error 


Figure  6.  'Stick"  or  "Ripple"  Mode  Weapon  Release 
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HOLLOMAN  AFB 

Hl-TACAN  RWY  33  Alamogordo,  new  Mexico 

lAt  f «USA»| 


Figure  7.  fyplcdl  Approach  Plate 
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TABLE  3.  SCORING  TABLE  FOR  HI-TAC,  RWY  33,  HOLLOMAN  AFB 


Leg 

Maneuver 

Transition 

Monitor 

Remarkd 

1 

Straight  descent 

DME=14.8+.2 

RAD  = 152+3 

HDG  = 332+5 

ALT  = 7500+5000 

Penetrate  20  nm  ring  @ 
11,800'  altitude 

2 

Check  point 

DME=14 . 8+. 2 

ALT  = 7500+200 

Alt.  check  @ 15  DME 

3 

Straight  descent 

DME=7 . 8+. 2 

RAD  = 152  +3 

HDG  = 332+5 

ALT  = 5500+2200 

4 

Check  point 

DME=7.8+.2 

ALT  = 5500+50 
CFG  = 6+1 

Alt.  check  @ FAP.  Wheels, 
Flaps,  SP  brakes  dn/out. 

5 

Final  apporach 

DME=2.8+. 2 

RAD  = 152  +3 
SPDLEG 

AOA  = 21+1 

Speed  to  be  a function 
of  gross  weight 

6 

Check  point 

DME=2. 8+.2 

ALT  = 4340+50 

Altitude  check  @ 3 DME 

7 

VFR 

Last  Leg 

SPDLEG 

AOA  = 20+3 

Fly  to  touchdown 



CFG  = 6+1 

TABLE  4.  SCORING  LABELS  FOR  APPROACH  PLATE  SET  UP 


Scoring 

Labels 


SPD 

ALT 

HDG 

CLM 

TRN 

AOA 

ROL 

GSD 

LOD 

RAD 

DME 

CHL 

CFG 

MMB 

OMB 


Descriptive  Name 


Calibrated  airspeed 
Altitude  above  sea  level 
Heading  (0  to  360°) 

Rate  of  climb 
Rate  of  turn 
Angle  of  attack 
Roll  angle 

Glide  slope  deviation 
Localizer  deviation 
TACAN  radial  (0  to  360°) 
TACAN  range 
TACAN  channel 
Configuration 
Middle  Marker  Beacon 
Outer  Marker  Beacon 


TEC  Input 
Units 

Scale 

knots 

B12 

feet 

B6 

degrees 

B5 

f t/min 

BO 

deg/min 

B5 

AOA  units 

B17 

degrees 

B5 

degrees 

B5 

degrees 

B5 

degrees 

B5 

nm 

BIO 

— 

BO 

— 

BO 

-- 

BO 

— 

BO 

I 


SCORING  ALGORITHM  - FLIGHT 

The  flight  scoring  algorithm  is 
Eg.  1,  shown  below.  The  algorithm  al- 
lows a student  a score  of  100  for  a 
normal  departure  or  approach.  Each 
flight  is  scored  individually.  The 
acutal  flight  of  the  F-15  is  compared 
to  the  required  vertical  and  posi- 
tional data  shown  on  SIDS  (Standard 
Instrument  Departures)  and  FLIP 
charts.  Tolerances  to  these  plate 
variables  and  other  monitored  vari- 
ables (such  as  speed)  consistent  with 
good  flight  practice  are  allowed.  If 
the  student  exceeds  the  tolerance  on 
the  monitored  variables,  he  is 


penalized  percentage  points  depend- 
ing on  the  time  and  magnitude  of  his 
intolerance.  His  final  score  is  100 
less  the  accrued  deductions. 


I tern  Deduction 


Out  of  tol . on  any  moni-  1 x N 
tored  parameter  (ea.  time) 

50%  ovei  tol.  (ea.  time)  2 X N 
100%  over  tol.  (ea.  time)  3 X N 
Wrong  tacan  channel  1 X N 


N = No.  of  1/2  minutes  in  each  out- 
of-tol . 

Score  = 100 -]^(doductions  above)  E(].l 


192 
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Obviously,  other  factors  than 
those  monitored  by  the  scoring  pro- 
gram will  bo  watched  by  an  alert  IP. 
Those  can  include  the  handling  of  mal- 
functions or  unusual  flight  condi- 
tions, the  verbal  check-off  proce- 
dures that  the  student  follows  with 
ground  control,  his  actual  flying 
"touch"  or  technique  and  a number  of 
other  items.  But  his  numeric  grade 
providing  an  unbiased  comparison  of 
performance  on  identical  missions  to 
his  classmates'  scores  will  be  a tell- 
ing measure  of  performance. 

SCORING  ALGORITHM  - TACTICS 


The  tactics  scoring  algorithm  is 
Eq.  2.  .^n 


Score  = 


(4 


n Eq . 2 . 


n = number  of  different  weapons  re- 
leased (or  bursts  of  gun) 

Pj,  = probability  of  ET  kill 

(=  0 or  1) 

For  each  successful  weapon  launch  Pj^, 
(probability  of  kill,  is  one),  the 
student  is  given  a relative  grade  of 
four  (4).  For  each  unsuccessful 
launch  (missed  target  and  Pj^=0),  a 
grade  of  zero  (0)  is  given.  These 
individual  grades  are  then  averaged 
for  a net,  single  grade  for  the  mis- 
sion. This  final  score  will,  of 
course,  range  from  zero  to  four. 

There  are  other  variables  auto- 
matically logged  at  time  of  weapon 
release.  These  are  printed  out  after 
the  mission  upon  request.  These  are 
shown  below  in  the  section  on  Scoring 
Displays.  These  variables  include 
(depending  on  the  attack  mode)  radar 
acquisition  time  (after  ET  was  acti- 
vated on  radar) , time  to  launch  an 
offensive  weapon,  etc.  These  vari- 
ables are  printed  out  for  the  IP's 
use  in  a more  subjective  analysis. 
While  these  additional  data  items  are 
not  automatically  (by  the  computer) 
assessed,  they  are  supplied  and  con- 
tribute to  an  overall  evaluation  of 
the  student's  tactical  performance  as 
determined  by  the  IP. 

SCORING  DISPLAYS 

Fig.  8 shows  the  display  that 
appears  on  the  right  hand  CRT  when 
the  IP  ends  the  problem  or  mission. 
This  page  displays  all  the  cues  to 
prompt  the  IP  for  the  scoring  or  data 
displays  he  wishes  to  see,  or  to  exit 


without  scoring.  For  instance,  he 
would  key  "SI"  for  the  Flight  Scoring 
Display;  "T1 " for  Tactics  Scoring 
Display;  "A2"  for  the  data  saved 
during  the  second  scored  flight,  etc. 
If  he  did  not  wish  to  score  the  last 
problem,  he  could  key  in  "C"  to  al- 
low him  to  initiate  and  fly  the  next 
problem.  Cues  are  also  provided  him 
to  allow  liard  copy  of  any  of  the 
scoring  displays.  Finally,  there  is 
a set  of  messages  to  remind  the  IP  if 
he  keys  a wrong  code.  These  latter 
messages  appear  in  the  space  called 
"ERROR  MESSAGE"  on  the  MENU  page. 

A sample  of  a Flight  Scoring 
Display  is  shown  in  Fig.  9.  This 
shows  seven  errors  the  pilot  com- 
mitted in  departing  Luke  AFB  via 
FLATIRON-TWO  departure.  He  had  four 
out-of-tolerance  conditions  on  the 
first  leg,  two  on  the  second,  and  one 
on  the  tliird  leg.  On  leg  3,  for  in- 
stance, at  problem  time,  one  minute 
and  three  seconds  (1:03),  at  18.8  nm 
DME , and  on  the  151  degree  radial, 
his  aircraft  heading  was  out  of  tol- 
erance. Its  maximum  (or  minimum) 
limit  was  33.4  degrees,  and  he  was 
off  heading  nominal  (plus  tolerance) 
for  32  seconds. 

Fig.  10  shows  a sample  of  Flight 
Data  Printout.  This  is  a copy  of  the 
flight  data  saved  in  core  and  trans- 
ferred to  disc  storage  during  a 
scored  flight.  If  the  IP  wants  to 
review  actual  flight  data  for  one  of 
the  scored  fliglits,  he  will  key  in 
the  correct  code  and  get  this  data 
printout . 

The  Tactics  Scoring  Display  is 
shown  in  Fig.  11.  Three  modes  of 
attack  are  available  to  the  student, 
Air-to-Air,  Air-to-Ground  (ox. 

CDIP) , and  Air-to-Ground  (CDIP). 

(CDIP  stands  for  Continuous  Displayed 
Impact  Point).  Various  data  is  saved 
for  a weapon  release  depending  on  the 
mode  as  noted  on  the  display.  The 
student's  total  grade  is  not  only  the 
"SCORi:"  of  2.8  which  represents  his 
total  success  in  hitting  the  several 
targets  (4.0  is  the  score  for  "kill" 
of  all  targets),  but  also  the  IP's 
evaluation  of  the  associated  data  on 
this  page. 

NEW  SCORING  CONCEPTS 

The  automatic  scoring  developed 
for  the  F-15  trainer  introduces 
unique  methods  to  provide  impartial 
and  detailed  grading  of  a student's 
performance.  These  adequately 
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FLIGHT  SCOniHC 

depabture 


airfield  LUKE  AF:  FLATIROH-IWO 


LEG  HO. 

P Tlf.E 

DME 

RADIAL 

PARAtiEIER 

rAX.VAL 

THIE  CUT 

1 

0:00; A3 

16.4 

125 

SPD 

309.0 

1 

1 

0:00: 42 

16.2 

125 

RAD 

124.3 

3 

I 

0:00: 44 

16.5 

124 

ALT 

12600.0 

4 

1 

0:00: 4G 

16.6 

128 

SPD 

332.0 

5 

2 

OtOOifA 

17.6 

132 

CL« 

114 

3 

2 

0:00:36 

17.9 

140 

AOA 

16.7 

3 

i 

0:0 1 103 

18.8 

151 

HOC 

33.4 

32 

GCORE  87 


Figure  9.  Flight  Scoring  Display 
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FLICHT  DATA  - LUKE  AFC  FLA TI ROU -TUO 


IltiF. 

OtOO: 41 

0:00: 42 

0:00: 43 

OtOO: 44 

0:00:45 

OtOO; 46 

SPt.E3(CAS) 

U14 

312 

309 

0 

0 

0 

At  71  TUDE 

I2U50 

12400 

12450 

0 

0 

0 

heading 

i7 

317 

0 

0 

0 

0 

R C Cl.InC 

442 

-442 

0 

0 

586 

132721 

R 0 TURN 

120 

-120 

0 

0 

0 

0 

ALTA 

i.i 

3.3 

3.3 

3.3 

3.3 

3.3 

R 'LL 

O 

-7 

0 

0 

0 

0 

G3  L'EU 

0.20 

-0.24 

0.00 

0.00 

0.00 

0.00 

LOG  CE7 

0.60 

0.00 

0.00 

0.00 

0.00 

o.co 

T.  RADIAL 

129 

0 

0 

0 

0 

0 

T.  rang; 

16.0 

0.0 

0.0 

0.0 

0.0 

0.0 

T.  CHANNEL 

27 

42 

43 

44 

45 

46 

CONFIG 

0 

0 

0 

0 

0 

0 

LATITUDE  N /30:E9:OOH 

28:09:071) 

0:00:0011 

0:00:001) 

0:00:001) 

0:00:00 

LONGITUDE  W-R6:6e:00'J-81  :E6:58U 

0:00:00V 

0:00:00u 

0:00:00V 

0:00:00 

CT  WEIGHT 

41 J87 

41387 

41367 

413E7 

41387 

41222 

TJUCHDOUN 

0 

0 

C 

0 

0 

0 

CTR  Range 

14. A 

12.6 

0.0 

0.0 

0.0 

0.0 

11  fE 

OjOO: 47 

0:00: 4P 

0:00: 49 

0:00: 50 

0:00:51 

0:00:52 

S'^EED(CAS) 

331 

332 

332 

0 

0 

0 

ALT'TUDE 

12520 

12400 

1230D 

0 

0 

0 

HE.ADING 

0 

0 

Q 

0 

0 

0 

R 0 CLIfir- 

442 

442 

0 

0 

586 

132721 

R r,  TURN 

0 

0 

0 

0 

0 

0 

ALFA 

3.3 

3.3 

3.3 

3.3 

6,0 

5.0 

n JLL 

0 

0 

0 

0 

0 

0 

C3  D'U 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

LOG  DLV 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

T.  RADIAL 

128 

0 

0 

0 

0 

0 

T.  RANGE 

16.7 

0.0 

0.0 

0.0 

0.0 

0.0 

T.  CHANNEL 

27 

48 

49 

50 

51 

52 

CONFIG 

0 

0 

0 

0 

0 

0 

LA  n TUOE  N 

0;00:00M 

0:00:001) 

0;00;00tl 

0:00:  ODll 

0:00:001) 

0:00:00 

LONGITUDE  W 

0:00:00V 

0:00: COW 

0:00:COV 

0;00:ODV 

0:00:00w 

0:00:00 

G-'  WEIGHT 

41222 

412222 

41222 

41222 

40000 

40000 

TOUCHl'CWII 

0 

0 

0 

0 

0 

0 

CTR  RANGE 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

TItlE 

0:00:53 

0:00:54 

0:00:55 

0:00: 56 

0:00:57 

0:00:53 

'REEDCCAS) 

320 

320 

320 

0 

0 

0 

ALTI TUDE 

12300 

12300 

12300 

0 

0 

0 

HEADING 

0 

0 

0 

0 

0 

0 

H 0 CLUiD 

126 

1 14 

0 

0 

586 

132721 

H 0 TURN 

0 

0 

0 

0 

0 

0 

ALFA 

12.0 

16.1 

16.2 

16.6 

16.7 

16.7 

ROLL 

0 

0 

0 

0 

0 

0 

CS  DEV 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

LOC  DEV 

0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

I.  RADIAL 

130 

0 

0 

0 

0 

0 

T.  range 

17.5 

0.0 

0.0 

0.0 

0.0 

0.0 

T.  CHANNEL 

27 

54 

55 

56 

57 

58 

P’lgure  10.  Flight  Data  Printout 
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lACIICS  SCORING 
Ain  TO  AIR 


ET  NO 

27 

12 

4 

ACC  TIME 

i 

*** 

9 

CAL  TIDE 

12 

10 

LNH  tu:e 

21 

1 1 

IIACII  NO 

0.6i 

1.60 

ALTITUDE 

A1318 

80000 

SL  RNG 

5372 

2000 

ANG  OFF 

-5 

-4 

G-FOnCE 

APS-IG 

-3G 

-50 

1 .06 

*** 

2.00 

TGT-ALT 

37285 

81000 

-HDG 

87 

180 

-MACH 

2.66 

3.26 

PK 

1 

0 

1 

MIS  sue 

MA 

MI  3 

MA 

AIR  TO  GROUND  CEX . CDIP) 


ET  HO 

42 

15 

21 

ALTITUDE 

40000 

1000 

8000 

DIVE  ANG 

0 

1 

0 

G -FORCE 

l.oo 

1.20 

1.00 

T AIRSPD 

474 

131 

355 

TANK  ANG 

0 

0 

0 

MIS  DIST 

50 

30 

5 

IIP  LNG 

-54 

-36 

126 

PK 

1 

1 

1 

AIR  TO  GROUND  (C'lP) 


ET  NO 
MIS  DIST 
UP  CMG 
AIM  ERR 
PK 


10 

69 

8 

1 


64 

K.?; 

-1?6 

U63 

0 


SCORE-  2.8 


Figure  11.  Tactics  Scoring  Display 


satisfy  the  needs  and  requirements  ex- 
pressed at  the  proqram  definition  for 
F-15.  The  technitjues  and  capabilities, 
however,  for  additional  or  more  in- 
depth  evaluation  have  not  all  been 
examined  on  this  project. 

There  are  many  other  scorinq 
concepts  that  could  be  applied  for  a 
more  comprehensive  tost  of  student's 
skill.  This  paper  is  not  appropriate 
for  a detailed  discussion  of  addition- 
al scorinq  potential  but  a brief  out- 
line of  practical  extensions  will  be 
noted : 

1.  Tactics  Scorinq:  See  Fiq.  11. 

The  score  at  the  bottom  of  the 
paqe  is  simply  an  averaqe  of  the 
4's  and  O's  for  "hits"  or 
"misses"  of  the  student's  re- 
leased weapons.  The  IP  must, 
himself,  provide  weiqhtod  anal- 
ysis of  the  other  data  on  this 
paqe.  The  computer  could  handle 
the  analysis  of  the  rest  of  the 
data  --  Are  the  radar  acquisi- 
tion times,  the  UHF  call  times, 
the  weapon  launch  times  too  lonq? 
Is  the  slant  range  right  for  re- 
lease of  this  weapon?  Is  this 
the  right  weapon?  Etc. 


2.  Programs  can  readily  be  prepared 
to  demonstrate  certain  aerobatic 
maneuvers.  Similarly,  additional 
coding  can  evaluate  the  student's 
skill  in  performing  the  same 
maneuvers . 

3.  Scorinq  can  bo  utilized  to  deter- 
mine the  timely  and  correct  re- 
sponse to  a library  of  malfunc- 
tions . 

4.  Flight  proficiency,  that  is,  spe- 
cific manual  response  to  audio  or 
visual  cues,  during  turbulence, 
landing  or  takeoff  can  be  deter- 
mined . 

5.  The  student  pilot's  ability  to 
take  adequate  measures  to  pre- 
vent airborne  collision  with 
another  aircraft  can  be  measured. 
His  response  to  imminent  colli- 
sion can  also  be  determined. 

6.  Timely  and  correct  procedures 
for  electromagnetic  counter- 
measures can  be  graded. 

7.  Navigation  performance  can  be 
evaluated  for  various  cross  - 
country  missions. 
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COMMLRCIAL  PARTS  - NOW,  LATER,  OR  NEVER 


FRANKLIN  W.  ROZELL 
Nava?  Training  Equipment  Center 


Events  of  the  past  few  years  have 
forced  government  contractors  to  exert 
greater  efforts  on  reducing  their  cost 
of  operations.  Cost  for  materials  has 
naturally  been  one  of  the  principle  areas 
of  concentration.  F'any  contractors  have 
concluded  that  these  costs  are  needlessly 
high  because  of  the  governinent ' s insis- 
tence on  using  military  type  parts.  A 
strong  movement  is,  therefore,  afoot  to 
promote  greater  use  of  commercial  parts. 
Papers  have  been  circulated  extolling 
their  advantages-  speeches  are  being  made 
by  political,  business,  and  military 
leaders  suggesting  serious  consideration 
be  oiven  to  using  available  off-the-shelf 
type  eguipment  and  contractors  are  dis- 
mayed that  reguirements  to  use  military 
type  parts  still  exist. 

On  the  contrary,  we  have  seen  or 
heard  very  little  on  the  virtues  of 
using  military  type  parts.  Maybe  too 
many  people  have  just  taken  it  for  granted 
that  nothing  need  be  said  since  this  is 
just  the  way  it  has  been  for  as  long  as 
most  of  us  can  remember.  Manufacturers 
have  innumerable  facts  about  their  pro- 
ducts and  can  be  expected  to  cite  their 
advantages;  however,  only  one  government 
organization  is  actively  gathering  infor- 
mation on  or  promoting  the  use  of  military 
parts.  Procurement  Officers  leave  it  to 
the  specification  writers  and  the  specifi- 
cation writers  are  reluctant  to  change  for 
a number  of  reasons  that  will  be  explained 
later.  Also,  no  one  group  or  organization 
within  the  government  or  private  industry- 
can  possibly  know  the  full  cycle  of  opera- 
tions, costs,  maintenance  tasks  or  support 
operations  involved  in  all  the  types  of 
standard  parts.  As  an  example,  a standard 
relay  is  used  in  a diversity  of  applica- 
tions, branches  of  service,  and  environ- 
mental conditions  in  the  U.S.  and  foreign 
countries,  ee,  at  NAVTRAEQUIPCEN,  may  know 
how  this  relay  is  used  in  training  devices, 
but  not  on  other  applications  by  other  activ- 
ities. It  would  help  to  have  an  unbiased 
thorough  evaluation  of  each  part  as  to  why  it 
is  used,  how  it  is  used,  who  uses  it,  and 
what  standards  must  be  met  for  each  appli- 
cation. However,  the  whole  purpose  of 
using  military  type  parts  is  to  avoid  such 
costly  studies  and  allow  parts  to  be 
selected  with  full  confidence  that  they 
will  meet  stated  characteristics. 


A requirement  for  a new  approach  is 
apparent.  Conditions  are  changing  and 
the  government  is  lessening  its  resolve 
to  stick  wholly  to  military  type  parts. 

The  wedge  is  economics  and  the  necessity 
to  obtain  as  much  as  possible  for  each 
obligated  dollar.  It  is  extremely  diffi- 
cult for  procurement  officials  to  explain 
why  a contract  did  not  go  to  the  low  bid- 
der, and  contracts  with  design-to-unit- 
production-cost  clauses  rely  heavily  on 
low  acquisition  costs.  More  and  more 
commercial  parts  are  creeping  into  govern- 
ment inventories. 

This  paper  will  present  no  startling 
new  theories,  no  facts  previously  unknown 
to  man,  and  no  recently  discovered  data 
sources.  However,  we  will  try  to  present 
some  basic  reasons  why  the  government 
does  specify  military  type  products,  what 
efforts  are  underway  that  may  offer  some 
reasonable  solutions  and  what  changes  we 
may  expect  in  the  future. 

C 0 St  C 0 ns i d e r a t j o ns 

Since  the  heart  of  the  problem  is 
connected  to  economics,  let  us  first 
examine  the  cost  situation.  One  of  the 
problems  is  that  the  pro-commercial  users 
tend  to  concentrate  on  the  initial  or 
acquisition  cost  of  these  products  and 
may  not  be  fully  aware  of  possible  later 
consequences.  The  government  is  actually 
moving  more  and  more  to  an  analysis  of 
the  ultimate  or  life  cycle  cost  as  the 
prime  consideration.  Unfortunately,  data 
on  other  than  acquisition  costs  usually 
does  not  exist  in  a readily  available 
data  bank  or  cannot  be  acquired  in  the 
desired  format. 

Maintenance  costs  are  a very  serious 
problem  for  the  DoD.  Maintenance  and 
operational  costs  account  for  over  70%  of 
the  1978  budget.  Such  costs  can  easily 
be  ten  times  the  acquisition  costs  for 
the  life  of  a training  device.  The  DcD 
is  already  desperately  seeking  an  inex- 
pensive solution  to  this  expensive  problem. 

Commercial  parts  place  a heavier 
and  possibly  unnecessary  burden  on 
maintenance  costs  because  they  require 
special  treatment  in  so  many  instances. 
First  of  all,  they  require  that  another 


99 


item  be  carried  in  inventory;  they  fre- 
quently require  special  tooling  or  test 
equipment  over  and  above  what  is  presently 
available;  they  require  separate  handbooks, 
manuals,  and  parts  catalogs;  they  require 
individualized  training  of  personnel  for 
operation  and  maintenance  and  may  require 
unique  methods  for  processing  parts, 
handling  and  storage.  All  of  these  factors, 
plus  others,  should  be  considered  when 
evaluating  whether  it  is  cost  effective 
to  use  a commercial  part  or  not. 

As  an  example,  we  will  evaluate  a 
few  of  the  more  basic  cost  factors  such 
as  cost  of  repair  and  cost  of  establishing 
and  maintaining  an  inventory.  Perhaps 
just  these  few  costs  will  give  us  some 
indication  of  the  magnitude  of  the  total 
cost  involved. 

It  will  help  to  first  make  some 
assumptions.  Let  us  accept  the  MIL-HDBK- 
217  statement  that  a high-reliability 
standard  part  is  twenty-five  times  more 
reliable  than  a commercial  part.  To  be 
realistic,  we  will  reduce  this  factor  to 
10  to  1,  since  all  standard  parts  will 
not  be  of  the  high-reliability  type.  A 
rough  estimate  of  a weapons  system  trainer 
is  that  it  may  include  50,000  parts. 

Suppose,  we  assume  also  that  only  1/10  of 
these  presently  military  type  parts  become 
commercial  parts  and  each  of  these  parts 
are  used  2*2  times/device,  making  a total 
of  2,000  different  items.  Average  part 
cost  will  also  be  taken  as  Sl/part  for 
commercial  parts  and  S3/part  for  military 
type  parts. 

Some  other  standard  cost  figures 
that  we  may  use  are:  $200/ item  entry 
cost  into  the  federal  inventory,  $150/ 
item/year  inventory  maintenance  cost  and 
$20/hr.  labor  cost. 

We  also  will  assume  that  a standard 
part  fails  once  every  ten  years.  There- 
fore, with  the  assumed  failure  rate,  we 
would  have  ten  failures  of  the  commercial 
Dart,  or  one  per  year.  The  cost  of  the 
comriercial  failed  parts  would  be  5,000 
parts  X 1 failure/yr  x 10  yrs  x $l/part 
or  $50,000.  The  military  part  would  cost 
5,000  parts  x .1  failure/yr  x 10  yrs  x 
$3/part  or  $15,000.  Labor  costs  for  '2 
hr/repair  of  commercial  parts  would  be  5,000 
X l//ear  x 10  yrs  x hr  x $20  hr  = 

$500,000,  while  it  would  be  only  1/10  as 
much  or  $50,000  for  the  higher  reliability 
mi  1 i tary  type  part . 

The  difference  in  inventory  cost 
would  be  even  greater.  This  is  because 
there  is  really  no  requirement  to  maintain 
any  inventory  on  any  conmercial  part  that 
has  an  interchangeable  military  type.  One 


of  the  primary  benefits  of  standardi- 
zation is  really  to  stock  only  those 
items  with  the  most  applications  in 
order  to  decrease  the  variety  of  items 
that  must  be  maintained  in  inventory. 
Therefore,  using  our  prior  assumptions, 
as  applied  to  2,000  different  types  of 
parts  that  would  not  be  in  inventory  if 
military  parts  were  used,  we  find  that 
we  have  burdened  the  government  with 
2,000  parts  x $200/part  entry  + 2,000 
X $150/yr  x 10  yrs  = $3.4  million  over 
a 10  year  life  cycle. 

The  difference  in  cost  for  just 
these  few  considerations  is  a whopping 
$3,885,000  over  a 10  year  period. 

We  will  grant  that  different  assump- 
tions can  be  made  and  different  results 
might  be  obtained.  However,  our  interest 
is  merely  to  illustrate  a few  of  the 
costs  of  some  necessary  government  sup- 
port functions  that  are  normally  not 
included  by  suppliers  when  evaluating 
military  type  parts  versus  commercial 
part  cost  factors.  More  functions  could 
be  evaluated,  but  just  these  few  illustrate 
what  a tremendous  amount  of  tax  dollars 
are  at  stake. 

I[u  a 1 i f i c a t j_o_n  Te  s_t  i ng 

The  objective  of  using  military  type 
parts  is  to  attain  higher  reliability, 
greater  durability,  and  maximum  versatility. 
Characteristics  enhancing  these  objectives 
are  designed  into  military  type  parts  and 
the  parts  are  then  subjected  to  extensive 
qualification  testing  to  assure  that  they 
comply  to  these  required  design  charac- 
teristics. Unfortunately,  this  testing 
is  expensive  and  the  cost  must  be  added  to 
the  cost  of  the  part.  Contractors  must, 
therefore,  pay  a little  more  to  get  the 
assurance  that  the  part  has  better  quality, 
dependability  and  performance.  Prior 
testing  of  commercial  parts  varies  and  it 
can  be  inconsistent,  limited  to  selected 
characteristics  and  usually  is  not  con- 
ducted by  an  impartial  and  independent 
testing  laboratory. 

Delivery  Problems 

Another  objection  to  military  type 
parts  is  the  extended  delivery  time. 

Delivery  could  take  two  to  three  times 
that  required  for  cotiriercial  parts.  Six 
months  is  not  considered  abnormal;  however, 
this  does  not  apply  to  all  parts.  The 
contractor's  procurement  people  already 
know  which  types  of  parts  require  extended 
delivery  times  and  measures  can  be  taken 
to  design  in  and  procure  the  long-lead 
items  early  in  the  procurement  cycle.  Pro- 
blems should  only  occur  when  design  changes 
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must  be  made  and  new  parts  ordered  or  when 
requests  for  waivers  to  use  nonstandard 
commercial  parts  are  submitted  for  approval 
too  late  in  the  life  of  the  contract. 
Preliminary  in-plant  testing  is  expected 
to  cause  some  design  revisions,  but  delays 
in  submitting  the  RFW's  should  not  occur 
and  can  be  very  costly  to  the  contractor. 

Suppresj^ion  of  Innovative^  Design 

The  American  manufacturer  has  long 
been  characterized  as  being  ingenious 
and  expected  to  use  innovative  ideas  in 
his  designs.  Commercial  parts  manufacturers 
claim  that  standardization  and  the  require- 
ments to  use  military  type  parts  suppresses 
the  contractor's  ability  to  be  innovative. 
These  requirements  may  delay  the  inno- 
vative designer,  but  should  not  suppress 
his  ingenuity.  Innovative  parts  can 
always  become  qualified  as  "Standard" 
parts,  but  it  does  take  some  extra  effort 
for  specification  writing  and  testing. 
Manufacturers  frequently  fail  to  recognize 
that  there  are  advantages  to  being  listed 
on  a qualified  product  list.  The  delay 
and  difficulties  encountered  by  con- 
scientious contractors  is  recognized  by 
the  DoD  and  solutions  are  being  sought 
to  shorten  the  cycle  between  drawing 
board  and  QPL.  Some  of  the  more  promising 
approaches  will  be  explained  later  in  this 
paper. 

Part  Obsolescence 

An  advantage  of  military  type  parts 
that  is  mentioned  only  occasionally  is 
that  they  are  much  less  likely  to  be  de- 
clared obsolete  and  no  longer  available 
as  replacement  parts.  Sources  of  supply 
of  commercial  parts  are  frequently  limited 
or  sole  source.  The  government  is  often 
left  without  a source  when  a sniall  manu- 
facturer goes  out  of  business  or  just 
decides  that  a model  is  no  longer  profit- 
able to  produce.  Commercial  parts  also 
tend  to  be  unavailable  as  direct  replace- 
ments as  time  progresses.  Several  gener- 
ations of  a particular  conriercial  part 
can  come  into  existence  in  a ten  year  span. 
What  started  as  minor  improvements  can 
progress  to  the  point  where  the  eventual 
part  only  slightly  resembles  the  original 
part.  Direct  part  for  part  interchange- 
ability  then  becomes  difficult.  When 
■•eplacement  parts  are  no  longer  inter- 
changeable or  become  unavailable,  the 
government  inventory  procuring  activity 
is  not  equipped  to  make  a major  redesign 
effort  to  accept  substitute  parts.  It 
then  becomes  necessary  to  take  the  system 
out  of  operation,  send  it  to  a contractor 
and  issue  a contract  to  redesign,  refur- 
bish, and  modify  the  device  to  accept  pre- 
sently available  parts.  True,  refurbish- 


ment is  necessary  at  some  time,  but 
obsolete  comercial  parts  hasten  the 
time  when  this  becomes  necessary.  It  is 
not  unusual  to  pay  almost  as  much  to  modify/ 
refurbish  a device  as  it  originally  cost. 

P a r^  W a r ra  n tjes 

An  approach  under  consideration  is  to 
have  commercial  parts  manufacturers  offer 
warranties  on  their  products.  Surely,  it 
is  suggested,  a warranty  is  better  than  a 
qualification  test.  This  option  may  be 
easily  applied  in  private  industry,  but 
not  in  the  government  where  it  is  very 
difficult  to  control  and  can  be  very  expen- 
sive in  time  and  money.  To  begin  with, 
out  of  the  50,000  parts  mentioned  before, 
possibly  a maximum  of  500  could  be  parts 
where  a manufacturer's  warranty  may  be 
applicable.  Some  of  these  may  have  warran- 
ties and  some  may  not.  Warrantied  parts 
must  be  clearly  marked  or  users  will  not 
even  be  aware  that  the  parts  can  be  re- 
turned for  repair.  The  time  cycle  for 
removing  the  parts,  making  out  paperwork, 
sending  the  part  back  to  the  manufacturer, 
and  possibly  waiting  months  for  the 
repaired  part  to  wend  its  way  back  through 
the  necessary  channels  will  tempt  local 
maintenance  crews  to  attempt  local  fixes. 
This  will  cause  unnecessary  repair  costs 
(although  unauthorized)  and  could  result 
in  loss  of  warranty  due  to  tampering. 

Even  if  strict  orders  prevented  this, 
what  incentive  is  there  for  the  manufac- 
turer to  observe  a fast  turnaround.  An 
extended  return  cycle  can  only  be  coun- 
tered with  an  extra  quantity  of  spares 
on  hand.  This  again  would  result  in 
increased  cost  to  the  government. 

P r e s e n^^  J nj  n dl 

Many  activities  are  presently  seek- 
ing the  optimum  approach  to  the  military 
versus  commercial  parts  question.  The 
government  is  open  to  suggestions  and 
trying  to  be  flexible.  To  begin  with, 
many  commercial  subsystems  are  already 
being  used.  The  requirement  for  computers 
and  peripheral  equipment  had  a lot  to 
contribute  to  this  trend.  The  government 
recognized  that  such  equipment  is  under- 
going almost  daily  change.  Improvements 
are  being  made  literally  overnight.  It 
was  a case  o^  accepting  a costly  outmoded 
design  or  buying  an  item  that  represented 
the  latest  state-of-the-art,  possibly 
at  a significant  cost  savings.  Each  item 
(or  subsystem)  of  considerable  value  is 
now  evaluated  in  light  of  total  cost  and 
its  ability  or  potential  for  being  support- 
ed. The  government  is  considering  train- 
ing, provisioning,  tools  and  test  equip- 
ment, maintainability,  inventory  expense, 
manuals  and  handbooks,  the  support  process 
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itself,  and  the  availability,  qualification 
and  cost  of  personnel.  This  evaluation 
concept  has  resulted  in  a significant 
increase  in  comercial  type  equipment  being 
used  in  training  devices.  Major  assemblies 
or  subsystems  can  support  separate  provi- 
sions for  manuals,  training  and  support, 
but  individual  components  such  as  inte- 
grated circuits,  resistors,  switches, 
lamp  assemblies  and  other  assorted  items 
can  not. 


parts  should  be  used,  which  are  available 
and  which  will  require  long  lead  times. 

This  early  clarification  of  parts  criteria 
will  possibly  avoid  some  later  redesign 
or  reprocurement  costs. 

MIL-STD-749  is  the  standard  document 
used  to  detail  how  a contractor  can  re- 
quest a waiver  to  use  a nonstandard  part. 
This  document  specifies  all  kinds  of 
extra  requirements  and  added  costs  to  the 
contractor  if  he  wants  to  use  a nonstandard 


The  sister  Military  Parts  Control 
Advisory  Groups  (MPCAG)  set  up  by  the  DoD 
offer  great  promise  in  several  areas. 

The  more  senior  organization,  the  Defense 
Electronics  Supply  Center  (DESC)  has  made 
many  contributions  in  the  coordination 
and  preparation  of  specifications,  arrang- 
ing QPL  tests,  reviewing  requests  for 
waivers  and  attempting  to  make  the  process 
of  usit;g  military  type  parts  easier, 
quicker,  and  more  consistent.  The  other 
MPCAG,  the  Defense  Industrial  Supply  Center 
(DISC)  has  until  recently  concentrated 
on  hardware  and  fastening  devices,  but  is 
now  widening  its  vistas  to  include  other 
mechanical  type  items.  DESC  has  consider- 
ably shortened  the  evaluation  process  in 
reviewing  requests  for  waivers.  Indivi- 
dual telephone  inquiries  can  provide  same 
day  service.  A list  of  ten  to  twenty  items 
will  generally  require  only  five  to  seven 
days  for  a written  response  with  recommen- 
dations. DESC  does  not  restrict  their 
recommendations  to  only  military  type 
parts.  They  recommend  "preferred"  type 
parts.  These  could  be  preferred  commercial 
parts,  selected  from  the  available  non- 
standard type  parts,  or  preferred  military 
type  parts  where  several  military  types  are 
available.  Their  experience  in  reviewina 
specific  parts  and  their  excellent  staff  of 
specialists  in  various  categories  have 
resulted  in  activities  of  all  three 
services  using  the  same  preferred  high 
quality  parts.  Where  there  is  a demand  for 
a commercial  part  and  no  standard  exists, 
DESC  will  prepare  a specification  and 
coordinate  the  necessary  arrangement  for 
QPl  certification.  This  has  significantly 
shortened  the  time  cycle  for  converting 
many  nonstandard  parts  to  standard  military 
type  parts. 

The  proposed  MIL-STD-965  is  another 
case  where  the  DESC  has  taken  steps  to 
assist  the  contractor.  It  proposes  that  a 
preliminary  conference  be  held  very  early 
in  the  contract  life  between  representa- 
tives of  the  contractor,  DESC,  and  the 
procuring  activity  to  establish  which 
types  of  proposed  parts  will  be  acceptable 
and  which  types  should  be  avoided.  This 
removes  much  the  uncertainty  on  the 
part  of  the  contractor  on  which  types  of 


part.  The  full  application  of  MIL-STD-749 
ct  'Id  cost  the  contractor  more  to  use  a 
nonstandard  commercial  part  than  to  use  an 
approved  military  type  part.  The  emergence 
of  the  MPCAG's  has  allowed  DoD  activities 
to  accept  the  MPCAG  recommendation  without 
requiring  the  preparation  of  full  specifi- 
cations and  test  data.  The  submission  of  a 
page  from  a vendor's  catalog  is  frequently 
sufficient  for  approval  since  DESC  or  DISC 
is  usually  familiar  with  the  part  and  its 
characteristics. 

We  may  eventually  see  manufacturers 
siibmitting  their  commercial  products  to  a 
government  activity  for  preparation  of 
specifications,  testing,  and  qualification. 
Testing  costs  will  probably  still  be  borne 
by  the  manufacturer  and  will  be  similar 
for  competitive  products.  Specification 
costs  may  be  borne  by  the  government  for 
items  meeting  some  established  criteria. 
Alternate  sources  of  supply  must  continue 
to  be  encouraged  for  obvious  reasons. 

The  application  of  Logistic  Support 
Analysis  to  some  of  the  more  recent  con- 
tracts offers  an  interesting  new  source 
of  data  that  may  be  helpful  in  future 
comparisons  of  military  versus  commercial 
parts. 

There  is  no  doubt  that  lack  of  data 
makes  an  evaluator  more  cautious  and  t**-! 
inclination  is  to  resist  change  and 
stick  with  what  is  familiar  - 'n  . 
case,  military  type  parts.  There*  • ■ 
has  been  usual  practice  to  spei  •' 
military  parts  and  make  the 
supply  the  burden  of  proot  t*-.* 
cial  part  is  completely  ade,..s' 
application.  New  dat  ' -n  fe..* 
frequency  of  repair,  'at  • 
costs,  and  inventory 
a\ailable  on  repar^at ' 
da  a . Some  of  ' ne  . ■ 
effect  of  tonnet 
moved . 
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flpxibility  to  meet  those  needs  that  does 
not  exist  in  all  military  type  parts. 
Commercial  parts  are  usually  less  expen- 
sive to  procure,  some  effectively  pro- 
vide functions  not  available  in  military 
type  parts,  and  they  will  always  be  the 
technical  leaders  in  advanced  designs. 

There  are  advantages  and  disadvan- 
tages to  military  type  parts  just  as  well 
as  there  are  to  commercial  parts.  We 
can  not  afford  to  disregard  standard  parts 
or  ignore  commercial  parts.  There  is  a 
proper  place  for  each,  but  we  must  find 
out  which  one  fits  which  niche.  My  con- 
cern is  primarily  to  make  you  and  other 
decision  makers  conscious  of  the  need  to 
consider  all  facets  before  any  expensive 
mistakes  are  made.  Private  industry,  the 
government  and  all  of  us  as  taxpayers, 
can  ill  afford  costly  errors  of  judgment 
at  this  time. 

”uch  work  still  remains  to  be  done. 
The  guesswork  must  be  eliminated  and 
the  evaluation  process  simplified.  We 
need  better  data,  new  guidelines  and 
procedures,  life  cycle  costing  criteria, 
better  controls  on  and  knowledge  of  part 
applications  and  universal  industry  stan- 


dards for  comnercial  parts. 

It's  going  to  take  a concerted  effort 
by  the  government  and  private  industry.  Work 
groups  and  committees  must  be  established 
to  develop  facts,  data,  and  direction 
and  new  policies  implemented.  It  can't  be 
done  by  individual  activities  or  companies. 

It  affects  too  many  people,  too  many 
operations,  and  too  much  money.  It  must 
be  done  initially  at  the  policy  level. 

The  government  is  very  fortunate 
that  many  commercial  parts  are  available 
and  functionally  comparable,  and  in  many 
cases  interchangeable  with  military  type 
parts.  Commercial  parts  will  always 
have  a market  and  the  government  will  be 
part  of  that  market.  The  government's 
share  of  the  market  is  growing  and  will 
continue  to  grow.  Some  commercial  parts 
can  almost  be  considered  as  standards 
now,  others  may  never  meet  the  criteria 
for  government  use.  However,  if  a 
commercial  part  is  good  enough  and  used 
in  enough  applications,  it  will  eventually 
evolve  into  a military  type  part  and 
this  should  happen  a lot  Quicker  in  the 
future  than  it  does  now. 
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AbstracJ 

Increased  emphasis  has  been  placed  (m  the  need  for 
and  usefulness  of  major  aviation  training 
di'Vices  - flight  simulators.  A description  of  a modern 
trainer  and  the  status  of  current  simulation  is  provided. 
High  fidelity  is  necessary  to  achieve  high  training 
transfer  to  the  aircraft.  The  authors  describe  the  need 
fiir  and  a proposed  basir  apprfMch  to  technical  simulator 
flight  testing  designed  to  achieve  high  fidelity.  Ideas 
were  formulated  as  a result  of  the  authors'  participation 
in  the  development  and  validation  of  the  SH-2F‘  Weapons 
System  Trainer,  Device  ZF'106.  NAVAIHTESTCEN  partic- 
ipates in  the  program  as  a technical  advisor  on  flight 
fidelity.  Major  contributions  are  aircraft  testing  for  the 
establishment  of  <riteria  data  followed  by  simulator 
evaluation,  both  performed  by  engineering  test  pilots  and 
flight  test  engineers.  These  evaluations  used  established 
an<l  disciplined  flight  test  techniques  and  shrmid  be 
corom«)nplace  m the  development  and  validation  of  flight 
trainers.  An  extensive  table  of  criteria  data  tests  is 
prf>vided  for  reference.  Typical  instrumentation  tables 
for  both  the  aircraft  an<l  trainer  are  included.  Specific 
comments  are  made  concerning  trainer  testing  problems 
and  the  priorities  of  tests.  A discussion  is  included  on 
simulator  data -gathering  techniques,  appropriate 
pararoefers,  and  equipment  needed.  KinaiJy,  the  scope  of 
a visual  system  evaluation  is  presented,  along  with  a 
description  of  its  usefulness  in  additional  testing  of  the 
basic  trainer. 

Background 

The  Department  of  Defense  has  proposed  a procure- 
ment effort  of  j>ver  $800  million  on  flight  simulators  in 
the  next  I years  (reference  1).  This  represents  a resur- 
gence of  military  interest  in  simulators  spurred  on,  in 
part,  by  the  fuel  shortage  of  1973.  Prior  to  that,  the 
airlines  and  NASA  had  made  significant  advanc«>s  in 
flight  simulation.  The  reduced  cost  of  training  in  a 
simulator  has  often  been  presented  as  justification  for  its 
pro<  urement.  Other  arguments  are  based  on  the 
in<  reased  amount  of  training  made  jHissible  with  a 
training  devue  when  compared  with  the  limited  aircraft 
assf'ts  available.  The  potential  for  regular  Krhr  days  in 
active  training  in  the  simulator  causes  quantum  jumps  in 
comman<i  produ<  tivity.  However,  the  most  dramatic 
result  from  the  additnm  of  a simulator  sue  h as  the  SH-ZF 
Weapons  System  Trainer  (WST),  Device  ^FlOb,  is  in  the 
improved  quality  of  training.  Response  to  emergency 
situations,  V)me  of  which  are  not  practical  for  actual 
flight,  ran  be  learned  .ind  prat  tired  in  a high  fidelity 
simulator.  Realistic  tactical  military  situatKms  that  are 
often  impossible  to  est.iblish  in  attual  flight  tUiriiig 
peacetime  can  be  enrtmntered.  The  high  fidelity  of  the 
performance  and  flying  ({ualities  of  the  device  is 
essential  to  the  realism  required  to  adequately  train  for 
these  missions. 


There  is  a stigma  associated  with  all  flight  trainers 
due  to  the  varying  degrees  of  poor  fidelity  provided  by 
many.  Grand  claims  and  limited  practical  utility  of  even 
the  most  expensive  trainers  have  led  to  repeated 
disappointments.  Nevertheless,  simulated  flight  time  has 
been  authorized  as  a substitute  for  actual  flying 
experience.  Concurrently,  actual  military  flight  time  has, 
in  many  cases,  been  severely  reduced.  If  the  desired 
readiness  i.s  to  be  maintained,  these  new  trainers  intended 
to  replace  Actunl  flight  time  must  be  capable  of  providing 
high  training  transfer.  Increased  flight  fidelity  is 
necessary  to  obtain  this  high  transfer.  Skills  learned  and 
practiced  in  a trainer  can  only  be  applied  directly  to  the 
aircraft  if  adequate  fidelity  exists  with  the  aircraft 
characteristics.  A high  fidelity  flight  trainer  offers  the 
potential  for  a variety  of  additional  applications,  such  as 
accKient  investigation,  the  development  of  improved 
operational  procedures,  or  the  evaluation  of  proposed 
aircraft  modifications.  .As  a specific  example,  research 
such  as  the  evaluation  of  new  shipboard  approach  lighting 
could  be  economically  ac'complished  m a validated  high 
fidelity  trainer.  The  utility  of  such  a d»‘VKe  is  in  many 
ways  limited  only  by  its  availability  an<l  the  imagination 
of  the  user. 

Purpose 

Generally  speaking,  the  procurement  of  major  aviation 
training  devices  should  be  tre.^teil  sirniLirly  to  that  of 
new  aircraft.  Specif ically,  the  use  of  established  and 
disciplined  flight  test  technKjues  should  be  commonplace 
in  the  development  and  validation  of  thesf*  tlevices.  The 
simulator  manufacturer  must  be  prepared  to  demonstrate 
predetermined  levels  of  trainer  fidelity  with  the  aircraft 
data.  Time,  procedures,  and  necessary  equipment  must  he 
planned  into  the  development  program  to  a<  rc»mplish  this 
goal.  Airframe  and  aircraft  subsystem  manufacturers 
should  be*  informed  and  resp«mMve  to  thi»  nei'ds  ot  the 
simulator  manufacturers  for  specific  design  data  and 
ecjuipment.  This  requirement  is  often  concurrent  with 
developmeiit/production  of  the  aircraft  systems,  due  to 
the  desire  to  use  the  trainer  as  the  aircraft  is  introdu<  ed 
operationally.  Significant  coordination  and  cooperation, 
not  to  preclude  commercial  contrac  ts,  are  r«*quired  if  the 
needs  of  the  service  are  to  b**  met.  The  purpose'  (»f  this 
pajier  is  to  desc  ribe  the*  need  for  and  a proposed  basic 
approach  to  technical  simulator  flight  fidelity  testing. 

The  proposed  approac'h  includc'd  h»*re  was  formulated 
as  a rc'sult  of  the  authors'  participation  in  the  ib'velop- 
ment  and  procuremc*nt  ol  the  SH-2K  WST.  Dc'vicc*  2Fl0b. 
The  program,  completed  in  Novemb»*r  l97^,  produced 
exceptional  flight  fidelity  for  the  Navv’.s  first  modern 
helicopter  flight  trainer  ancl  is  bc'ing  usi'd  at  the  Rotary 
Wing  Aircraft  Test  Dtr-'ctorate  as  a guideline  f.)r  future 
work.  Scdec  ted  data  illustrating  the  fidelity  c)btain<'d  are 
present**!!  m appt*ndix  A.  fMiotographs  of  the*  trainer  are 
contain«»d  in  appendix  B.  F’rc'St'ntly,  a CH  C3perational 


Fh{;ht  Trainrr  (OFT)  and  an  SH-3H  OFT  are  active 
projects  with  anticipation  of  RH-53D,  CH-53E,  and 
LAMPS  MK  in  trainers  in  the  future. 

Navy  Trainer  Procurement  Team 

The  N AVAIRTESTCEN  team  is  part  of  a larger  group 
organized  to  ensure  the  success  of  a new  trainer.  A brief 
overview  of  the  major  participants  in  a Navy  procure- 
ment follows.  NAVAIR  is  chajrged  with  funding  and 
overall  program  management.  Close  coordination  is 
established  with  the  Naval  Training  Equipment  Center 
(NAVTR AEQUIPCEN)»  where  a contracting  officer  and  a 
program  engineer  are  assigned.  The  program  engineer 
provides  working-level  management  of  the  acquisition.  A 
Fleet  Project  Team  (FPT)  is  assigned  by  the  Office  of 
the  Chief  of  Naval  Operations  (OPNAV)  through  the 
appropriate  operational  commanders.  This  team  usually 
consists  of  instructor  pilots  and  aircrew  from  the 
eventual  using  activity  such  as  the  specific  type  training 
squadron.  These  individuals  provide  the  invaluable 
contribution  of  current  fleet  experience  with  the 
particular  aircraft.  In  the  past,  these  pilots  were 
erroneously  expected  to  become  instant  experts  on  flying 
qualities  and  performance  (FQ&P)  evaluating.  Today,  in 
addition  to  extensive  systems  verification  and  qualitative 
flight  testing,  the  FPT  has  the  prime  respon.  for 

directing  the  development  of  the  instruc  'ace 

system  based  on  its  intended  training  requi 

The  eventual  recipient  of  the  trainer  is  the  Fleet 
Aviation  Specialized  Operational  Training  Group 
(F ASOTR AGRU).  This  organization  is  responsible  for 
facility  management,  maintenance,  and  operational 
readiness  of  the  device  in  support  of  the  using  activity. 
N AVAIRTESTCEN  participation  involves,  as  a minimum, 
a test  pilot  and  engineer  team  to  act  as  technical  advisor 
to  NAVAIR  and  the  Program  Engineer  (N AVTR AEQUIP- 
CENI  on  FQIcP.  The  contractor  team  generally  consists 
of  a program  manager,  computer  specialists,  and  various 
systems  specialists  including  an  aerodynamicist. 

N AVAIRTESTCEN  Policy 

The  general  guidelines  for  N AVAIRTESTCEN 
participation  were  established  in  coordination  with 
NAVTR AEOUIPc'EN  and  NAVAIR  and  are  contained  in 
reference  1.  The  major  elements  of  that  instruction  are: 

a.  Establish  liaison  with  the  appropriate  NAVAIR  and 
NAVTRAEOUIPCEN  personnel 

b.  Provide  assistance  during  specification  prepara- 
tion, proposal  evaluation,  and  source  selection  phase. 

c.  Monitor  the  contractor's  development. 

d.  Provide  NAVAIRTESTCEN  developed  flight  test 
data  for  incorporation  in  the  trainer  specification,  for 
contractor  baseline  data,  and  as  the  standard  for 
measurement  of  simulation  fidelity. 

e.  Review  math  model,  criteria  report,  and 
Acceptance  Test  Procedures  and  comment  on  their 
applicability. 

f.  Conduct  Navy  Preliminary  Evaluations  (NPE's)  as 
required. 


g.  Participate  in  government  in-plant  acceptance 
tests. 

h.  Provide  engineering  and  test  pilot  assistance  in 
adjusting  hardware  and  sf>ftware  programs  to  achieve 
proper  flight  fidelity. 

i.  Participate  in  government  on-site  acceptance 
tests. 

j.  Participate  in  validation  of  subsequent  trainer 
units  during  in-plant  and  on-site  acceptance. 

k.  Conduct  periodic  follow-on  tests  and  evaluations 
to  assess  the  effects  of  design  changes. 

l.  Prepare  reports  of  flight  fidelity  evaluations  for 
distribution  to  NAVAIR,  N AVTRAEQUIPCEN,  and  the 
training  device  contractor. 

The  policy  contained  in  this  instruction  has  been  success- 
fully applied  to  several  fixed-wing  and  rotary-wing 
programs.  NAVAIRTESTCEN  participation  is  best 
utilized  from  the  earliest  evolutions  including  prepara- 
tion and  review  of  requirements,  proposals,  and  specifi- 
cation documents  through  final  acceptance. 

Typical  Milestones 

The  usual  milestones  of  an  acquisition  program  for  a 
training  device  are  included  here  for  general  informa- 
tion. This  description  applies  when  N AVTRAEQUIPCEN 
acts  as  the  procuring  activity;  in  some  situations, 
NAVAIR  acts  directly  as  the  procuring  activity.  A 
document  defining  an  operational  requirement  is 
generated  in  OPNAV.  Interested  parties  are  convened  by 
NAVAIR  and  NAVTRAEQUIPCEN  to  produce  a document 
entitled  "Military  Characteristic,"  which  specifically 
describes  the  features  that  would  be  required  to 
accomplish  the  desired  mission.  After  receiving  authori- 
zation from  NAVAIR,  N AVTR AEOUIPCEN  creates  a 
detailed  specification  and  solicits  proposals  from 
interested  contractors.  Source  selection  is  based  on  the 
evaluation  of  these  proposals.  A contract  is  made 
through  NAVTRAEQUIPCEN  with  the  selected  manufac- 
turer. The  contract  usually  includes  an  integrated 
logistics  support  package  and  numerous  deliverable  data 
items,  such  as  math  model,  design,  data,  facilities,  and 
test  procedures  reports  in  addition  to  the  trainer  itself. 
Several  NPE's  precede  the  in  -plant  acceptance  of  the 
device.  Government  in-plant  acceptance  tests  are 
conducted  on  the  complete  system  to  determine  if  it  is 
ready  for  fleet  delivery.  Following  this  acceptance,  the 
device  is  disassembled,  relocated  at  the  designated 
training  facility,  and  reassembled.  Government  on-site 
acceptance  testing  is  conducted  prior  to  formal 
acceptance  of  the  trainer.  Following  this  final  accept- 
ance, specific  hardware  and  software  changes  continue 
throughout  the  useful  life  of  the  trainer  to  improve  it 
and  maintain  a comparable  configuration  with  the  fleet 
aircraft.  Annual  verification  of  trainer  fidelity  is  also 
conducted. 

Modern  Trainer  Description 

Modern  trainers  such  as  Device  2F106  are  character- 
ized by  an  exact  replica  of  the  cockpit  and  crew  station 
containing  functional  and,  in  some  cases,  actual  aircraft 
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equipment.  rontro),  navi^ationt  rommunirations* 

an<i  weapon!*  systems  are  mcnleled  in  addition  to  most 
other  aircraft  systems.  A full  h-deg-of-freedom  mcition 
base  IS  hydraulically  powered  and  driven  by  romputer- 
j^enerated  romm.inds.  Some  fixed-win^  trainers  meet 
their  requirements  with  less  than  the  b-de^j-of -freedom 
motion  system;  ht)wever,  helirf)pter  and  other  Vertical 
TaKeoff  and  Landinjj  (VTt)l.)  applications  specifically  use 
this  full -motion  system  to  adequately  simulate 
low-speed  flvintf  i^ualities.  A full  ran^e  of  aircraft 
vibrations  for  normal  and  emergency  situations  adds  to 
the  simulated  environment  as  a result  of  the  pro^^ram- 
mable  motion  system.  Sound  systems  electronically 
generate  air-rush,  rot-'r,  enjjine.  and  accessories’  noise 
into  the  cockpit.  V'arious  types  of  visual  systems  can 
accurately  present  spatial  information  to  the  pilot. 
Moving  targets,  such  as  ships  and  other  aircraft; 
functional  li^htin^  systems,  such  as  glide-slope 
indicators  and  strobe  lights;  and  detailed  geographic 
features  are  routinely  included  in  visual  scenes. 
Instructor  stations  provide  interactive  displays  and 
dedicated  controls  for  manipulation  of  mission  configu- 
ration, malfunctions,  environment,  and  communications. 
Instructor-assistance  features  normally  include 
demonstrations,  exercises,  checkrides,  audio  recordings, 
ground-track  displays,  and  automatic  initialization 
capabilities. 

Subsystems  and  eissistance  features  are  linked  togeth- 
er and  function  simultaneously  in  real-time  via  the 
digital  computation  system.  Simulated  aircraft  systems, 
trainer  systems,  environmental  programs,  and  executive 
programs  create  great  demands  on  the  general-purpose 
digital  computer.  The  flight  dynamics  program  is  very 
extensive  and  is  the  major  concern  in  improving  flight 
fidelity.  Numerous  other  systems  are  cued  from  the 
flight  dynamics  program,  including  all  instruments,  the 
sound  and  motion  systems,  and  the  visual  system. 
Flexibility  must  be  designed  into  this  program  in  order  to 
later  refine  the  F'Q&P  fidelity.  Computational  speed  and 
accuracy,  particularly  for  the  flight  dynamics  program, 
ar«*  imperative  if  satisfactory  flight  fidelity  is  to  be 
attained.  Iteration  rates  of  16  or  20  Hz  appear  to  be  the 
minimum  acceptable  for  this  purpose. 

The  complete  operational  flight  envelope  of  the 
aircraft  can  and  should  be  simulated  with  high  fidelity. 
This  eliminates  training  restrictions  and  allows  the 
trainer  to  be  used  for  various  mission-related  tasks.  In 
some  cases,  simulation  should  go  beyond  the  normal 
flight  envelope,  for  example,  the  demonstration  of 
departure  characteristics  (fixed-wing)  or  blade  stall 
(helicopter). 

Flight  Data  Requirement 

An  extensive  data  base  is  required  to  ensure  that  the 
level  of  fidelity  is  sufficient  throughout  the  flight 
envelope.  In  the  past.  Navy  test  programs  did  not 
produce  sufficient  mid-envelope  aircraft  data  for  trainer 
development.  Sophisticated  data  collection  systems  now 
generally  employed  for  new  aircraft  testing  have  reduced 
this  problem  However,  a requirement  for  additional 
aircraft  flight  testing  in  support  of  the  trainer  develop- 
ment has  been  the  general  rule.  This  is  particularly  true 
when  dealing  with  an  older  in-service  aircraft  that  may 
have  undergone  evolutionary  changes  in  design.  Past 
reliance  on  wind-tunnel  and  theoretical  stability  data 


and  uninstalled  engine  performance  data  has  resulted  in 
marginal  fidelity.  In  helicopter  simulation,  the  classical 
aerodynamic  solutions  are  not  as  well  defined  as  in 
fixed-wing  aircraft  or  rocket-powered  vehicles.  In 
general,  the  data  requirements  for  trainer  development 
are  classified  into  two  categories:  design  data  and 
criteria  data.  Design  data  are  required  elements  such  as 
weight  and  balance,  cockpit  layout,  structures,  wiring 
logic,  fuselage  and  rotor  system  physical  characteristics, 
wind-tunnel  estimates,  moments  of  inertia,  etc.  Much  of 
this  type  of  data  is  commercially  available  to  the 
simulator  manufacturer.  Criteria  data  are  generally 
those  provided  by  N AVAIRTESTCEN  through  test  and 
evaluation. 

A typical  matrix  of  criteria  data  tests  is  presented  in 
appendix  C.  The  presentation  includes  a list  of  required 
tests,  appropriate  data  presentations,  and  specific 
comments.  This  is  a general  outline  intended  to  be 
modified  as  necessary  to  meet  the  needs  of  a specific 
aircraft  configuration  or  mission.  The  data  base  should 
be  extensive  enough  to  provide  parameter  isolation  as 
much  as  economically  possible.  This  procedure  will  allow 
simulator  program  changes  to  be  less  random,  more 
effective,  and  more  timely.  Due  to  the  detail  of 
simulation,  it  is  necessary  to  obtain  data  that  interrelate 
systems  such  as  the  rotor,  engines,  flight  controls,  and 
airframe.  The  most  obvious  example  would  be  in  slow- 
speed,  low-altitude  flight  characteristics  where  the 
environment,  performance,  and  flying  qualities  interre- 
late significantly.  This  may  be  the  most  challenging  area 
of  helicopter  simulation  due  to  its  mathematical 
complexity.  Criteria  data  should  be  gathered  for  each 
system  simultaneously  in  order  to  establish  proper 
relationships  in  the  simulation. 

Flight  test  data  must  be  extensively  documented. 
Known  factors,  such  as  aircraft  configuration,  gross 
weight,  CO,  pressure  altitude,  air  temperature,  wind,  and 
all  normal  flight  test  parameters,  roust  be  identified  for 
each  test.  When  repeating  the  test  in  the  simulator, 
these  factors  are  assigned  values  as  recorded  during  the 
aircraft  test.  In  this  manner,  variables  between  the 
aircraft  and  simulator  tests  are  minimized  and  data 
obtained  are  comparable. 

Aircraft  Testing 

The  aircraft  testing  necessary  to  provide  these 
criteria  data  should  be  done  using  standard  flight  test 
techniques  (references  3 and  4)  by  a trained  test  pilot.  It 
is  highly  desirable  to  have  the  same  team  perform  both 
aircraft  and  simulator  evaluations.  This  assignment 
policy  ensures  maximum  efficiency  in  technique  and  data 
transfer,  as  well  as  flexibility  in  further  testing  that  may 
be  required.  In  addition  to  these  advantages,  criteria 
data  provided  by  a government  agency  such  as  NAVAIR- 
TESTCEN  are  objective  and  not  influenced  by  specifica- 
tion guarantees  and  design  goals.  Simple  *hand-held 
instrumentation"  and  "kneeboard-recorded  data*  provide 
flexibility  in  aasessing  several  aircraft.  This  method  is 
particularly  useful  for  mechanical  characteristics  and 
some  static  tests.  However,  the  required  precision  of 
flight  test  data  demands  much  more  reliable  and 
in-depth  technical  data  gathering.  Significantly  improved 
flight  fidelity  requires  a serious  effort  to  obtain  detailed 
criteria  data,  particularly  in  flight  dynamics.  For 
instance,  time  histories  of  angular  acceleration  and  rate 
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are  more  useful  than  the  resultant  attitude.  An  instru- 
mented aircraft  of  the  appropriate  confit^uration  is 
necessary.  A typical  instrumentation  package  is  <letai|ed 
in  appendix  D,  table  I.  The  airrraft  should  be  provided 
early  in  the  program  so  that  data  may  be  obtained, 
processed,  and  provided  to  the  <onlract«>r  without 
causing  program  delays.  These  data  may  then  be 
incorporated  in  appropriate  documents  such  as  the 
criteria  report  and  acceptance  test  procedures.  In  this 
manner,  the  standards  for  acceptance  will  have  been 
established  for  the  simulator  evaluations  to  follow. 

Simulator  Testing 

Evaluation  of  the  training  device  for  KQ^*P  fidelity 
should  be  accomplished  by  a trained  test  pilot  using 
standard  flight  test  techniques  as  in  the  aircraft.  This 
has  seldom  been  done  in  trainer  programs  except  by 
N AVAIRTESTCEN  in  acct»rdance  with  its  current  poluy. 
It  IS  in  sharp  contrast  with  most  previous  programs  in 
which  the  trainer  manufacturer  selected  the  appropriate 
data  «ind  determined  th<»  test  methods  which  were  then 
accomplished  by  the  contractor  or  the  FPT.  Today,  the 
trainer  evaluation  is  nearly  identical  in  scope  to  that  of 
the  aircraft  as  presented  in  appendix  C.  A very  large 
portion  of  the  effort  is  devoted  to  control-response 
testing  and  validation  of  the  flight  dynamics.  In  s<jme 
tests,  limitations  to  standard  proc  edures  are  encountered 
due  to  an  incomplete  environment,  i.e..  the  lack  of  a 
visual  system  when  attempting  visually  referenced  test 
methods.  In  this  case,  modified  procedures  need  to  be 
developed  to  provide  the  information  usually  obtained 
from  visual  reference.  If  possible,  the  modified  test 
techniques  should  be  evaluated  in  the  aircraft  and  test 
results  compared  with  those  from  standard  test 
techniques.  An  example  of  this  problem  is  encountered 
in  lateral-directional  statics  while  attempting  steady- 
heading sideslips.  In  this  test,  a visual  reference  is 
c ustomarily  used  for  turn  rate.  The  turn-needle 
presentation  to  the  pilot  can  also  be  used,  however*  it  is 
not  nearly  as  accurate  as  a properly  planned  visual 
reference.  In  the  Simulator,  turn  rate  is  computed  very 
ac  curafely.  This  more  precise  value  can  be  displayed  on 
the  instruc  tor's  console.  With  some  coordination,  turn 
rate  as  displayed  can  he  included  in  the  now  combined 
s(  ans  of  the  test  pilot  and  instructor  and  used  as  the 
quality  factor  for  the  data  point  as  in  the  aircraft.  Other 
examples  of  m<*dified  techniques  include  using  Doppler 
readouts  of  drift  angle  and  ground  speeri  for  establishing 
pre^  i«e  hover  or  translation  sideward,  rearward.  <>r  slow 
forward  for  trimmed-control  positions.  i)n  simulations 
without  Doppler,  the  display  of  'rthogonal  veloc  ities  on 
the  instrui  tor's  conscde  would  suffice.  Altitude  hold 
features  of  the  aircraft  or  the  use  of  a single  parameter 
freeze  capability  in  the  trainer  assist  in  obtaining 
in-ground  effe<  t data  points  where  pilot  workload 

may  be  excessive  without  a visual  referent  e.  Doppler 
information  or  velocity  readouts  can  also  be  used  tor 
vertical  climb  performanc  e tests  when  a visual  reference 
IS  not  available.  It  is  hard  to  imagine  a case  where  digital 
or  analc>g  information  could  not  be  monitored  real-time 
to  compensate  for  unavailable  ernes  during  tests.  These 
particular  problems  need  to  be  identified  early  and 
appropriate  solutions  planned  for. 

During  simulator  testing,  evaluators  must  be  prepared 
to  recognize  pilot  adaptability  to  the  flying  qualities  of 
the  simulator.  This  is  likely  to  cx'cur  when  performing  a 


unic|ue  task  such  as  hovering  and  when  other  cues  are  not 
available.  A pilot  ran  quickly  develop  the  nec  essary  scan 
and  technique  to  perform  a precise  task,  overcoming 
gross  fidelity  deficiencies,  either  contributing  factors  are 
the  potential  f'>r  many  hours  of  flight  time  in  the 
simulator  while  concentrating  on  a single  problem  area 
ami  the  lack  of  recent  aircraft  flight  time  for  the  test 
pilot  while  at  the  contractor's  facility  for  extended 
periods.  To  combat  the  latter,  arrangements  should  be 
made,  if  practical,  for  concurrent  aircraft  flight  time 
while  the  pilot  is  assigned  to  the  trainer  program. 
However,  quantitative  tests  should  be  designed  wherever 
possible  to  minimize  reliance  upcm  cjualitative  assess- 
ments that  may  be  influenced  by  incorrect  or  incomplete 
environments. 

Pilot  performance  and  qualitative  opinion  have  been 
observed  to  markedly  improve  with  the  ad.lition  of  major 
subsystems  that  provide  motion,  auit*l.  I'ld  visual  rues. 
This  IS  a testimony  of  their  necessity  in  training,  but  a 
caution  that  during  evaluations  their  absence  or 
uncorrected  false  cues  may  affe<*t  test  results.  A subtle 
example  of  this  type  of  problem  occurs  when  using  the 
visual  display  for  a ground  reference,  but  the  effects  of  a 
more  limited  field  of  view  such  as  increased  workload 
are  not  considered.  The  need  for  qualitative  testing 
remains  significant,  but  more  attention  to  test  design  is 
required  in  the  trainer  than  in  the  aircraft  if  the  results 
are  to  be  meaningful.  The  assistance  of  the  Fin"  pilots 
should  be  stressed  when  considering  qualitative  tests. 
Specific  debrief  by  the  N AVAIRTESTCEN  team  may  lead 
to  definition  of  problems  and  quantitative  testing  based 
on  their  observations. 

One  area  where  only  qualitative  simulator  flight 
testing  IS  presently  being  done  is  in  the  evaluation  of  the 
motion  system.  Criteria  data  for  vibration  characteris- 
tics are  used,  but  the  final  tuning  remains  qualitative. 
Engineering  tests  are  being  conducted  to  evaluate  the 
resp<»nse  characteristics  of  the  system  and  its  individual 
servoactuators.  The  results  confirm  the  mechanical 
quality  of  the  motion  system  but  have  no  direct 
relationship  to  its  effect  on  the  simulator  pilot. 
Currently,  there  are  more  than  a dozen  different  sets  of 
algorithms  in  use  for  moti«.in  system  integration  to  the 
simulator  flight  dynamics.  NASA  and  NAVTKAEQUIP- 
CEN  are  working  toward  optimization  in  this  area. 
Several  other  studies  .ire  unclerway  to  determine  the 
suitability  of  motion  systems  for  providing  onset  cues. 
Speculation  ranges  from  the  elimination  of  motion 
systems  altogether  to  using  them  for  static  attituiles 
while  providing  onset  cues  with  a controlled  seat  <levice. 
Research  on  this  subject  should  prove  highly  beneficial. 
The  strong  interrelationship  between  motion  and  visual 
cues  and  their  importann*  in  flying  helici'pter 
V’TOI.-type  aircraft  requires  <lose  evaluation  of  their 
re8pe<  tive  system  performance. 

A building-blork  approach  is  necessary  to  establish  a 
logical  test  sequence.  Early  evaluations  may  be 
restricted  to  a few  operational  systems.  In  general,  the 
following  priorities  should  be  established.  Test 
instrumentation  must  be  calibrated  and  all  sources  of 
data  output  verified.  This  includes  validation  of  all 
normal  cockpit  instrumentation.  Next,  control  system 
mechanical  characteristics  should  be  established.  At  this 
point,  standard  aircraft  checklists  provide  appropriate 
test  procedures  for  basic  cockpit  evaluations.  Static 
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performance  and  flying  qualities  necessarily  must 
precede  dynamic  evaluation  and  adjustment.  This  same 
build-up  approach  should  be  applied  to  basic  airframe 
characteristics  followed  by  increasing  levels  of  AFCS 
compensation.  Motion  system  checks  should  be 
performed  next*  followed  by  visual  system  validation. 
Extensive  testing  should  be  devoted  to  mission -related 
tasks  at  the  conclusion  of  this  sequence.  These  priorities 
are  not  intended  to  limit  the  conduct  of  evaluations. 
However,  consideratum  must  be  given  to  the  total  effect 
of  changes  made«  including  the  validity  of  any  results 
previously  obtained. 

Simulator  Data 

A number  of  specific  data-gathering  techniques  have 
been  established  for  the  simulator.  Aircraft  test 
conditions  can  and  should  be  matched  exactly  for  each 
test  in  the  trainer.  The  capability  to  instantaneously  stop 
the  computer  up<late  of  selected  parameters  or  all  flight 
dynamics  leads  to  what  has  been  termed  a "freeze" 
function.  By  the  judicious  use  of  "freeze"  and  the 
preestablished  and  recallable  "initial  condition"  function, 
the  process  of  data  gathering  can  he  dramatically 
accelerated.  In  addition  to  cockpit  data,  preselected 
parameters  can  be  digitally  presented  on  the  instructor's 
Cathode  Ray  Tube  (CRT)  display  to  provide  essentially 
on-board  instrumentation.  Line  printers  or  x-y  plotters, 
if  part  of  the  installation,  may  be  used  to  provide  hard 
copy  of  CRT-displayed  data  or  could  be  programmed  to 
plot  static  data.  For  dynamic  data  in  helicopter  simula- 
tors, there  is  a need  for  multiple  channels  of  analog  data. 
As  a minimum,  control  positions,  attitudes,  rates,  and 
accelerations  are  required.  Individual  parameters  should 
be  verified  to  be  suitable  for  comparison  to  the  aircraft 
data.  For  example,  control  positions  should  be  monitored 
at  the  same  location  as  in  the  aircraft.  Inherent  lags  in 
the  aircraft  control  system  are  not  accounted  for  if  the 
simulator  control  parameters  are  provided  from  the  rotor 
system  module.  The  channels  need  to  be  accessible 
through  a single  terminal  board  wired  to  the  digital- 
to-analog  converters.  Analog  recording  devices  are 
connected  to  this  terminal  for  real-time  simultaneous 
display  of  each  selected  parameter.  Immediate  analysis 
of  program  modifications  can  often  be  provided  with  this 
setup.  A simple  utility  program  for  simultaneous 
calibration  of  all  channels  has  proven  to  be  a great  time 
saver.  For  automated  data  processing  later  by  the 
computer  facilities  at  N AVAIRTESTCEN,  a tape- 
recording system  can  be  simultaneously  connected  to  the 
same  terminal.  A summary  of  typical  trainer 
*inatrumentation*  is  presented  in  appendix  D,  table  n. 

If  properly  planned  and  programmed,  the  outputs  of 
these  simulator  monitoring  systems  can  provide 
comparable  data  format  to  that  provided  by  any  airborne 
instrumentation  used.  Identical  paper  speeds  and 
parameters  scaling  are  obviously  necessary  for  direct 
comparison  of  dats.  Early  consideration  must  be  given 
to  the  characteristics  of  parameters  when  selecting  data 
format,  i*e*,  when  attempting  modifications  to 
acceleration  onset  in  tenths  of  s second,  the  minimum 
desirable  paper  speed  is  10  mm  per  second.  With  these 
systems,  it  is  possible  to  monitor  sufficient  parsmeters 
to  isolate  individual  problems  and  determine  the  effects 
of  changes.  What  results  is  an  iterative  process  to 
correct/improve  the  fidelity  of  specific  parameters. 
Aircraft  data  should  be  availsble  and  organized  in  a 


ready  reference  By8t«*m  for  immediate  access.  Sufficient 
time  must  be  given  to  analysis  of  appropriate  data  to 
provide  an  engineering  approach  to  progressive  changes. 
Development  sessions  quite  often  require  the 
N AVAIRTESTCEN  team  to  provide  testing  and  evalua- 
tion expertise  in  support  of  the  contractor.  These 
government -supported  development  efforts  should  be 
limited  in  duration  and  scheduled  only  after  the 
contractor  has  made  sufficient  progress  with  his  own 
capabilities  to  warrant  it.  Specific  milestones  should  be 
jointly  established  by  the  contractor  and  governmpnt 
representatives  as  a prerequisite  to  this  type  of  effort. 

Evaluations  to  determine  progress  and  current  status 
of  the  fidelity,  such  as  NPE's  and  acceptance  tests,  roust 
be  conducted  on  a fixed  configuration.  No  changes  should 
be  made  during  these  evaluations,  since  all  effects  due  to 
the  change  may  not  be  immediately  obvious.  For 
example,  changes  to  accessory  loads  for  rotor  engage- 
ment and  disengagement  characteristics  may  seem 
isoUt*'d,  but  autorotation  performance  is  directly 
affected.  AH  test  results  in  the  simulator  must  be 
identified  to  a specific  software  configuration.  It  is 
essential  that  the  contractor  provide  this  information 
and  adhere  to  rigid  administrative  procedures  to  control 
and  document  program  changes  and  reassemblies.  It  is 
equally  as  important  for  the  evaluators  to  adequately 
identify  and  catalog  the  voluminous  amount  of  data 
generated. 

Reporting  Procedures 

Deficiencies  must  be  formally  reported  as  they  are 
discovered.  Current  policy  is  for  the  program  engineer  to 
collect,  organize,  and  prioritize  all  Discrepancy  Reports 
(DR's)  on  standard  forms  provided  by  NAVTRAEQUIP- 
CEN.  A single  master  log  of  these  reports  is  thereby 
maintained.  For  technical  deficiencies,  it  is  necessary  to 
provide,  as  part  of  the  DR,  copies  of  appropriate  data  to 
fully  describe  the  problem.  DR's  are  furnished  to  the 
contractor  immediately  for  corrective  action.  Following 
each  evaluation,  or  as  appropriate,  N AVAIRTESTCEN 
submits  reports  directly  to  NAVAIR  by  message  in 
Project  Situation  Report  format.  These  reports  are 
temporary  by  design  and  describe  the  latest  documented 
status.  Final  documentation  of  the  trainer's  flight 
fidelity  is  provided  by  N AVAIRTESTCEN  by  formal 
report. 

Visual  System 

Of  particular  interest^  is  the  evaluation  of  visual 
systems.  It  is  important  to  recognize  that  the  visual 
system  dramatically  illustrates  basic  program  weak- 
nesses, as  well  as  its  own.  As  in  the  aircraft,  visual  cues 
are  overriding  to  the  pilot.  Unstable  visual  presentations 
are  capable  of  nauseating  pilots  within  minutes  as  a 
result  of  the  strength  of  the  visual  cue.  Visual  systems 
can  be  made  to  accurately  track  the  host  program  and 
still  not  be  suitable  for  training.  In  this  case,  modifica- 
tions to  the  basic  trainer  program  are  required.  It  is  best 
to  start  visual  system  integration  only  after  the  basic 
program  has  been  brought  to  a reasonable  level  of 
fidelity  and  has  been  well  documented.  Experience  has 
shown  that  trainers  intended  to  have  visual  systems 
should  not  be  accepted  on  the  assumption  that  visual 
system  integration  will  not  require  basic  program 
modifications.  Evaluation  logically  begins  with  the 
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instaliation.  Ind«»pend^nr4>  of  the  visual  system  from 
motum  system  inputs,  shielding  of  projectors,  and  simple 
cockpit  "light  leaks"  need  to  be  checked.  The  scene 
content  can  then  be  addressed.  This  includes  verification 
of  designed  runway  layouts,  targets,  ships,  landing  pads, 
lighting  systems,  etc.,  for  accuracy  and  detail  in  each 
scene.  Individual  display  shading  and  intensity  should  be 
evaluated  concurrently  with  scene  content.  Registration 
is  the  term  applied  to  alignment  of  a multiple  window 
visual  presentation  and  is  essentially  a spherical 
geometry  problem.  The  effect  of  a horizon  sloping  in  a 
forward  presentation  while  level  in  a sidelooking 
present.ition  can  cause  pilot  distirientation.  Synchroni- 
zation applies  to  the  coordination  problem  resulting  from 
a multiple  visual  computer  installation  when  the  scan 
r.^tes  of  input  <lata  are  not  identical.  The  perception  of 
this  problem  occurs  in  turns  (for  a side-by-side  installa- 
tion) as  an  alternating  shift  in  scene  content  by  the  two 
displays.  Both  registration  and  synchronization  should  be 
carefully  evaluated. 

Static  alignment  and  attitude  checks  are  normally 
d<ine  as  part  of  the  visual  systems  normal  maintenance 
check.  However,  dynamic  accuracy  is  necessary  if  the 
system  is  to  be  considered  satisfactory  for  training.  A 
calibrated  signal  representing  visual  attitude  in  each  axis 
must  be  established.  This  signal  should  originate  as  close 
to  the  at  tual  display  as  possible.  By  displaying  simulator 
attitude  and  visual  attitude  on  the  same  recording  device 
and  performing  single-axis  control  inputs,  visual  dynamic 
response  can  be  quantitatively  evaluated.  Control  inputs 
should  consist  of  btith  reversals  and  steps.  Attitude 
displacement  is  easily  compared.  System  lags  are 
pres»»nted  as  the  response  delay  measur'd  between 
simulator  and  visual  attitudes.  The  time  lag  which  must 
be  minimized  is  made  up  of  simulator  computation,  data 
transfer,  visual  system  computation,  and  display 
requirements.  Minimum  lags  are  necessary  to  preclude 
pilot -induced  oscillations,  particularly  while  attempting 
to  perform  closed*loop  tasks  such  as  hovering.  Simulator 
response  to  control  inputs  should  have  previously  been 
validated  so  that  testing  is  now  directed  toward  the 
visual  system  fidelity. 

After  the  visual  system  is  validated,  it  may  be  used 
as  a tool  for  further  evaluating  and  improving  specific 
areas  of  the  flight  dynamics  program.  In  general,  these 
areas  relate  to  ground  reference  maneuvers  such  as 
takeoff,  landing,  and  autorotation.  The  evaluation  of 
gffiund -handling  rharacteristics  requires  the  use  of  a 
visual  system.  Landing  gear  reactions,  steering,  braking, 
turning,  and  skidding  are  each  considered.  Many  mission- 
related  tasks,  such  as  shipboard  approaches  and  landings, 
ran  now  be  evaluated.  Extensive  qualitative  tests  should 
he  performed  using  all  scenes,  multiple  maneuvers,  and 
specifically  employing  each  means  of  problem  control. 
This  IS  necessary  to  ensure  that  the  various  modes  and 
controls  do  not  affect  the  fidelity  of  the  presentation.  In 
particular,  scenes  that  present  relative  motion,  such  as 
between  a moving  ship  and  the  aircraft,  or  ship  motion 
due  to  sea  state  that  feeds  hark  to  the  aircraft,  must  be 
closely  evaluated.  Minor  control  logic  differences  or 
nonmatched  update  rates  can  cause  very  significant 
problems  that  are  not  evident  without  the  visual  system. 

Bei  ause  of  the  strength  of  visual  rues,  it  is  important 
to  consider  the  planned  trainer  mission  when  deciding  on 
the  FOV  to  be  presented.  Ultimately,  an  identical  FOV  to 


that  of  the  aircraft  is  desirable.  Until  such  time  as  the 
state-of-the-art  can  provide  this  capability,  a trainer 
limitation  is  being  created.  In  helicopter  trainers,  the 
absence  of  the  lower  few  degreos  of  FOV  is  very  serious. 
Normal  vision  cues  used  for  precise  hovering  and  landing 
are  not  present.  Pilot  compensation  mu.st  be  made  by 
interpreting  distance  cues.  This  can  he  done  on  shore- 
based  scenes  cir  large-deck  ship  scenes,  but  it  is 
impossible  on  small-de<'k  ship  scenes  where  the  entire 
deck  may  be  out  of  view  due  to  "window"  location.  In 
general,  VTOL/helicopter  trainers  should  be  provided 
with  maximum  coverage  in  the  lower  segments  of  F'OV. 
Tra<lei)ffs,  if  necessary,  should  be  based  on  well-defined 
mission  needs.  Flight  testing  should  b»*  conducted  to 
optimize  window  location.  Various  configurations  of 
restricted  FOV  should  be  evaluated  for  effects  on  pilot 
workload. 

Conclusions 

The  renewed  interest  in  flight  simulators  is  based  on 
their  potential  to  reduce  costs  while  increasing  the 
amount  and  quality  of  aviation  training.  High  fidelity 
flight  simulators  are  necessary  if  the  desired  training 
transfer  is  to  be  achieved.  The  approach  to  trainer 
development  and  validation  presented  in  this  paper  led  to 
the  accomplishment  of  that  goal  in  the  SH-2F  WST 
program.  The  basic  concept  of  this  approach  is  that 
flight  trainers  should  be  evaluated  like  aircraft  by 
engineering  test  pilots  and  flight  test  engineers. 
Extensive  criteria  data  must  be  provided  from  an 
instrumented  aircraft  of  the  appropriate  configuration. 
Testing  of  the  aircraft  for  criteria  data  and  of  the 
trainer  for  fidelity  should  generally  follow  the  program 
outlined  in  this  paper.  Engineering  evaluation  of  the 
trainer  data  is  mandatory  if  the  advantages  of  this 
program  are  to  be  realized.  The  test  techniques  used 
during  the  trainer  evaluation  should  be  identical  to  those 
used  in  the  aircraft.  In  those  cases  where  limitations  to 
normal  testing  occur,  mcidifications  must  be  designed  to 
provide  comparable  data.  Trainer  evaluators  readily 
adapt  to  deficient  simulator  flying  qualities.  Tests 
designed  to  produce  quantitative  results  minimize  this 
problem.  In  addition,  concurrent  aircraft  flight  time  is 
highly  recommended.  The  effects  of  major  suhystems 
such  as  motion,  sound,  and  visual  must  be  carefully 
c<msidered  when  determining  test  sequence.  A trainer 
data  plan  that  includes  output  techniques  and  recording 
devices  is  a basic  element  of  this  approach. 

The  comparison  of  trainer  and  aircraft  flight  test 
data  when  properly  analyzed  provides  an  engineering 
approach  to  trainer  software  adjustments.  The  result  of 
this  process  is  a flight  trainer  that  exhibits  the  FQ&P 
characteristics  of  the  aircraft.  The  benefit  derived  is  a 
flight  trainer  usable  throughout  the  aircraft  envelope 
that  is  limited  only  by  its  availability  and  the  imagina- 
tion of  the  user. 

In  the  future,  government  requirements  for  trainer 
fidelity  will  undoubtedly  become  more  stringent.  A 
program  such  as  described  in  this  paper  will  receive  wide 
acceptance  and  result  in  increased  testing  performed  on 
trainers  to  meet  that  goal.  Manufacturers  of  trainers 
would  he  aided  by  this  program  by  receiving  more 
definite  guidelines,  specific  criteria  data  from  current 
flight  tests,  and  simulator  flight  test  data  on  which  to 
baae  modifications.  As  flight  dynamics  research 
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rontinu***  and  math  modeling  and  simulator  implemen- 
tation improvr,  the  iterative  testing  and  modifying 
t'urrently  necessary  would  be  reduced.  The  ultimate 
justification  wcnild  then  be  a va.stly  improved  trainer  at 
minimal  deveb^pment  cost. 
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Pitch  Axis  Control  Response 
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Dynamic  Visual  System  R#»sponsp 
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4 i 

. - » - , 

; 

- - j 

r-  I r 

t ^ 

Af’rFNDJx  r 

r«'sts  fiir  Kstabl»»hm<'nl  if  ( rjtMn.i  in  Air*  r*«ft  an'l  SmiuUtMr 


Tr«t 

Data  Presentation 

Remarks 

Weight  and  Balan<‘«> 

Gross  weight 

Longitudinal,  lateral 
and  vertical  CG 

CG  variation  with  fuel  burnoff 

Static  aircraft  attitude 

Verify  aircraft  loading 
configuration. 

Control  System 

Total  control  travel 

Control  8yst»»m  mechanical 

Mechanical  Characteristics 

chdracteristi'"s  should  be 

(’ontrol  free  play 

Breakout  forces 

determined  on  s**v»»ral  air- 
craft to  get  a good  data  bas»». 

Pilot  qualitative  comments  on 

Control  force  gradients 

boost  or  hydraulic  system -off 

and  hysterisis 

control  displacements  and 
force  gradients  should  be 

Control  centering 

recorded . 

Trim  system  lags  and 

Trim  rates  should  be 

trim  rates 

determined  as  a function 
of  control  travel  to  check 

Control  system  dynamics 

Control  system  coupling 

linearity. 

Engine  Start/Stt)p  Rotor 

Time  history  of  throttle 

Use  video  tape  coverage 

Engagement /Shutdown 

position,  engine  torque. 

(with  voice)  of  pilot  going 

rotor  torque,  rotor  speed, 

through  turnup  and  shutdown 

turbine  inlet  temperature, 

checklists.  Qualitative  comments 

gas  generator  speed  and 

gage/instrument  movement/ 

fuel  flow 

function  should  he  recorded  for 
each  affected  system. 

Ground-Handling 

Control  positions  and 

Primarily,  qualitative  comments 

Characteristics 

pitch  attitude  during 

on  ground  taxi/turning/braking 

ground  taxi  for  specific 
gkOun<l  speed,  wind  speed 
and  direction  and  sur- 
face elevation 

Pwr  increase  to  start  taxiing 

characteristics. 

Hover  Performance 

Hover  attitude  and  control 

Data  required  for  both  OGE 

positions 

Rotor  and  engine  power 
versus  gross  weight 

Collective  control  position 
versus  gross  weight 

Radar  altitude  versus 
engine  torque  iGE/engine 
torque  0(iE 

Rotor  power  versus 
engine  power 

and  IGE  hover  heights. 

Time  history  of  control 

Similar  conditions  (including 

positions,  attitudes,  and 

available  cues  and  identical 

rates  for  pilot  workload 

tasks  are  required  in  trainer 

analysis 

and  aircraft. 

Tpst 


Data  Pr»»SPntation 


R#*marks 


Control  positi»>ns  »olI 
attitiido,  and  ‘‘nKino 
t(irqup  v#*rsus  pac»»d 
ground  spood 


Control  positions,  pitch 
attitude,  and  engine 
torque  versus  paced 
ground  speed 

Control  positions,  pitch 
and  roll  attitudes,  engine 
torque  and  wind  speed 
versus  relative  wind 
azimuth 


Precise  measurement  of 
paced  ground  speed  and 
wind  speed  and  direction 
required.  Critical  azimuth 
data  should  be  obtained 
during  steady  winds  of 
approximately  10  kt  and 
^0  kt  (S.l  m/sec  and 
10.  Z m/sec)  . 


Vertical  Climb  Performance 


Rate  of  climb  versus 
engine  torque 

Collective  position  versus 
engine  torque 


Record  engine  torque 
required  to  hover  OGE 
before  commencing  climb. 
Use  torque  increments 
above  this  value. 


Airspeed/ Altimeter 
Calibration 


Airspeed  position  error 
for  level  flight,  climbs, 
and  descent 

Altimeter  position  error 
for  level  flight 


Engine  Performance 
Test  Cell  Data 
Power  Checks 


Corrected  engine  shaft 
horsepower,  corrected  gas 
generator  speed,  corrected 
fuel  flow,  corrected 
specific  fuel  consumption 
versus  corrected  turbine 
inlet  temfierature 


Engine  Dynamics 

Selected  throttle  move- 
ments  covering  full 
range  of  control 

Response  to  trim 
system  actuation 


Time  history  of  throttle 
position,  engine  torque, 
rotor  speed,  fuel  flow, 
gas  generator  speed,  and 
turbine  inlet  temperature 


From  time  histories  deter- 
mine lags,  overshoots, 
scheduling,  static  and 
transient  droop. 


Response  to  automatic 
load  sharing  system 
operation 
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T«*8t 


Data  Presentation 


Ilemarks 


Level  Flight  Performance 
and  Trimmed  Control 
Positions 

Referred  rotor  power 
versus  referred  true  air- 
speed for  a full  range  of 
referred  gross  weights  (can 
also  use  nondimensirinal 
presentation) 

Individual  rot^ir  power 
versus  calibrated  airspeed 

Ratio  of  main  rotor 
power  to  engine  power 
versus  calibrated  airspeed 

Control  positions,  pitch 
attitude,  sideslip,  and 
engine  torque  versus 
calibrated  airspeed 

Climb  and  Auto 

Performance  and  Trimmed 
Control  Positions 

Rate  of  climb  and  descent 
versus  calibrated  airspeed 

Control  positions  and  pitch 
attitude  versus  calibrated 
airspeed 

Power  Effects 

Control  positions,  pitch 
attitude,  and  cockpit 
vertical  velocity  versus 
#*ngine  torque 

Static  Longitudinal 

Stability 

Longitudinal  stick  force, 
stick  position,  and  pitch 
attitude  versus  calibrated 
airspeed 

Dynamic  Longitudinal 
Stability 

Short  Term 

Time  history  of  angular 
acceleration,  load  factor, 
rate  and  attitude  response 
to  control  doublet,  and 
pulse  inputs 

Long  Term 

Time  history  of  pitch 
attitude  and  airspeed 
response  to  slow  and  fast 
starts 

Static  Lateral-Directional 
Stability 

Control  positions,  bank 
!uigle,  ball  position,  rate 
of  descent,  and  indicated 
airspeed  versus  sideslip 

Data  should  be  collected  for 
ball-centered  flight.  The 
effects  of  sideslip  on  power 
should  be  determined.  Drag 
increments  should  be  deter- 
mined for  configuration 
changes  (i.e.,  external 
stores,  door/hatches  open, 
etc.).  Data  should  be  com- 
bined with  slow  speed  perfor- 
mance data  to  form  three 
dimensional  power  required 
curve. 


Power  fixed  at  given  trim 
condition. 


From  time  histories,  deter- 
mine period,  frequency  and 
damping  of  oscillation  or 
time  to  half  (double) 
amplitude. 

Trainer  tests  should  be 
conducted  on  motion  to 
induce  effects  of  control 
inertia  and/or  dynamics. 

Use  steady  heading  sideslip 
test  technique. 


Test 


Data  Presentation 


Remarks 


Dynamic  Lateral-Directional 
Stability 

Lateral  and  Pedal 
(‘ ontrol  Doublets 
and  F^ilse  Inputs 

Time  history  of  control 
posi  t ions « angul ar 
accelerations,  rates,  and 
attitudes 

From  time  histories,  deter- 
mine period,  frequency, 
and  damping  of  oscillation 
or  time  to  half  (double) 
amplitude . 

Cyclic  and  Pedal 

Only  Turns 

Time  history  of  control 
positions,  rates,  and 
attitudes 

Spiral  Stability 

Time  history  of  bank 
angle 

Release  from  Steady 
Heading;  Sideslips 

Time  history  of  control 
positions,  sideslip,  heading, 
yaw  rate,  roll  attitude, 
roll  rate,  and  airspeed 

Maneuvering  Stability 

C onstant  AItitu<le 

Constant  Power 

Longitudinal  stick  force 
and  stick  position  versus 
load  factor  or  bank 
<tngle 

Document  rcmtrol  force 
relieving  functions  if 
applicable,  and  account  for 
this  feature  in  test 
procedure . 

C'ontrol  Response 

Step  Control  Inputs 

Time  history  of  control 
positions,  angular  accelera- 
tions, rates,  and  attitudes. 
Also,  present  load  factor 
.tnd  airspeed  (except 
hover)  for  longitudinal 
inputs  and  load  fact<jr  for 
collective  inputs.  Minimum 
data  to  include  hover, 
normal  cruise,  and  fast 
cruise  for  multiple  sized 
inputs 

Emphasize  overlaying  aircraft 
and  simulator  time  history 
control  response  data  for 
Comparison.  Note  maximum 
acceleration/rate,  time  to  reach 
maximum  acceleration/rate  and 
initial  acceleration/rate  lag  to 
control  step  input.  Document 
cross  coupling  resulting  from 
single  axis  control  step  inputs. 
Document  basic  airframe 
characteristics  and  repeat  for 
each  appropriate  mode  of 

AFCS  operation. 

Autorotational  Flyint; 
Qualities 

Auto  Entry 

Time  history  of  control 
positions,  throttle  position 
engine  torque,  rotor  speed, 
attitudes,  and  rates 

C'ontrol  fixed  until  rotor 
speed  decay  or  attitude 
change  requires  recovery. 

Full  Autos 

Power  Recovery 

Time  history  of  control 
positions,  throttle 
position,  engine  torque, 
rotor  speed,  rates, 
attitudes,  sideslip,  air- 
speed , ground  speed 
(Doppler) , pressure 
altitude,  radar  altitude, 
and  load  factor 

Record  wind  speed  and 
direction  during  test. 

R/D  Parameter 

Isolation 

Determine  effect  of  rotor 
speed,  sideslip,  and  bank 
angle  on  rate  of  descent 
during  autorotation  from 
cockpit  gauges. 

Teftt 


Data  Presentation 


Ftemarks 


V'lbration 

Vibration  amplitude  versus 
frequency  for  mven 
condition  (airspeed  and 
loading;) 

Record  vibration  data  for 
pilot  and  copilot  station 
for  all  flight  regimes. 

Also  amplitude  versus 
calibrated  airspeed  for 
i^iven  frequency 

Stall 

Stall  boundary  as  a 
function  of  airspeed, 
rotf)r  speed,  density 
altitude,  and  loading 
condition 

Qualitative  comments  on 
vibration  and  attitude 
response  to  stall  and 
control  sequencing  required 

to  reduce/dggravate  the 

condition . 

AFC'S  Evaluation 

Document  pilot  workload 
required  for  identical 
tasks  under  each  mode 
of  AFC'S  operation 

Design  tests  to  evaluate 
each  mode  of  the  AFC^S. 

Repeat  appropriate  tests 
under  each  mode  of 

AFCS  operation 

APPENDIX  D 
rat)lp  I . 

Instrumentation 
SH-DI  BuNo  M8<^77 


Parameter 

Characteristic 

Recording  Device  ^ ^ ^ 

(2) 

Output  Device 

Longitudinal  Cyclic  Pos. 

Percent  from  Full  Fwd 

Data  Tape  Recorder/Pilot 

Cockpit  Indicator 

Lateral  Cyclic  Pos. 

percent  from  Full  Left 

Data  Tape  Recor<ier/Pilot 

C'orkpit  Indicator 

Dir.  Pedal  P<j». 

Percent  from  Full  Left 

Data  Tape  Recorder/Pilot 

(Cockpit  Indicator 

C'ollec  tive  Pos. 

Percent  from  Full  Down 

Data  Tape  Kecorder/Pilot 

('ockpit  Indicator 

Tail  Kotor  Pitch 

n*-K 

Data  Tape  Recorder/f’ilot 

f'ockpit  Indicator 

Pitch  Attitude 

Deg  Up  or  Down 

Data  Tape  Recorder 

Attitude  (lyro 

Roil  Attitude 

Deg  Left  or  Right 

Data  Tape  Reccirder 

Attitude  Gyro 

Yaw  Altitude 

Deg  Left  or  Right 

Data  Tape  Recorder 

Directiiinal  Gyro 
(Self-t'agmgl 

Pitch  Rate 

Deg/Set:  Up  or  Down 

Data  Tape  Recorder 

Rate  Gyro 

Roll  Rate 

Deg/Sec  Left  or  Right 

Data  Tape  Recorder 

Rate  Gyro 

Yaw  Kale 

Deg/Sec  Left  or  Right 

Data  Tape  Recorder 

Rate  Gyro 

Pitih  Ang.  Accel. 

Deg/Sec^  Up  or  Down 

Data  Tape  Recor<!er 

Angular  Accelerometer 

Roll  Ang.  Accel. 

|2SiBB0DDS9I 

Data  Tape  Recorder 

Angular  Accelerometer 

Yaw  Ang.  Accel. 

Data  Tape  Recorder 

Angular  Accelerometer 

Pariimotrr 


Lo.iii  Ka<  tor 
Siii»’slip 


Drjft 


Tvirn  and  Shp 


Wrtirai  Volority 


! Airsp»’<vl 


Torquo  (1  and  Z) 


I Altitude  ( Baro.  ) 


OAT 


Tim»* 


Wind 


Gross  Woij^ht 


Fuel  Load 
Frfint 
C*»nt**r 
Aft 


Ext»*rnal  Stores 


[)ej{  Left  or  Ri^ht 


Ft 


Kt 


Needle  and  Ball  Pos. 


Ft/Min 


Kt 


Percent 


Ft 


Dpk.  C 


Sec 


From  Oe^  Maj^/Vel,  Kt 


Percent 


Percent 


percent 


D.-g,  c: 


I.b 


Loaded/ Unloaded 


Recording  Device'  ' 


Pilot 


Data  Tape  Recorder/Pilot 


Data  Tape  Recorder/Pilot 


Data  Tape  Recfirder/Pilot 


Data  Tape  Recorder/Pilot 


Pilot 


Pilot 


Pilot 


Pilot 


Pilot 


Pilot 


Pilot 


Pilot 


Long.  CG 

In . 

T/H  Pow,.r 

Ft -Lb 

M/R  Power 

Ft -Lb 

C<mtrol  Ftjrce 

I.b 

Fuel  Flow 

Lb/Min 

Event  Marker 

Step  Signal 

Data  Tape  Recorder 


Output  Device 


Computed 


Crockpil  Indicat<^jr 


A/f'  Gau>(e  (Rad.  Alt.) 


A/C  (jauxe  (Doppler) 


A/C  Gaujje  (Doppler) 


A/f'  (lauge 


A/C 


Cal.  A/('  Clause 


Cal.  A/C  Gauge 


A/C  Gauge 


Cal.  A/C  Gauge 


Hand 'he  Id  Stopwatch 


Hand-held  Anemometer 
or  Tower  Report 


A/C  Gauge 


A/C  Gauge 


A/C  Gauge 


A/C  Gauge 


Computed 


A/C  Gauge 


As  Selected 


Computed 


(Ref.  Data) 


(Ref.  Data) 


Hand-held  Force  Gauge 


(Ref.  Data) 


Cockpit  Control 


NOTES:  (1)  Engineering  units  tape  will  he  created  from  FM  tape  in  aircraft  instrumentation  package.  Computer 
plotting  will  be  done  where  applicable. 

(2)  Equipment  indicated  is  special  instrumentation  unless  identified  as  aircraft  equipment. 
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APPENDIX  I) 
Tablo  II 

Inst  rum  pnt  at  ion 
Dpvicp  2F64C 


ParamPt**r 

Characteristic 

Recording  Device^ 

Output  Device 

Longitudinal  ("yrlir  Pos. 

Percent  from  Full  Fwd 

Analog  Recorder/lnstructor 

Console  Page 

Lateral  Cyrlic  Pos. 

Percent  from  Full  Left 

Analog  RecorderAnstructor 

Console  Page 

Dir.  Pptlal  Pos. 

Percent  from  Full  Left 

Analog  RecorderAnstructor 

Console  Page 

CoUprtiv#*  Pos. 

percent  from  Full  Down 

Analog  RecorderAnstruct()r 

Console  Page 

Tail  Rotor  Pitch 

Dfg 

Analog  RecorderAnstructor 

Console  Page 

Pitch  Attitude 

Deg  Up  or  Down 

Analog  RecorderAnstructor 

Console  Page 

Roll  Attitude 

Deg  Left  or  Right 

Analog  RecorderAnstructor 

Console  Page 

Yaw  Attitude 

Deg  Left  or  Right 

Analog  RecorderAnstructor 

Console  Page 

Pitch  Rate 

Deg/Sec  Up  or  Down 

Analog  RecorderAnstructor 

Console  Page 

Roll  Rale 

Deg/Sec  Left  or  Right 

Analog  RecorderAnstructor 

Console  Page 

Yaw  Rate 

Deg/Sec  Left  or  Right 

— 

Analog  RecorderAnstructor 

Console  Page 

Pitch  Ang.  Accel. 

Analog  Recorder 

- 

Roll  Ang.  Accel. 

Analog  Recorder 

- 

Yaw  Ang.  Accel. 

2 

Deg/Sec  Left  or  Right 

Analog  Recorder 

- 

Load  Factor 

K 

Pilot 

Computed 

Sideslip 

Deg  Left  or  Right 

Analog  RecorderAnstructor 

Con.sole  Page 

Radar  Altitude 

Ft 

Analog  RecorderAnstructor 

Console  Page 

Ground  Speed 

Kt 

Analog  RecorderAnstructor 

Console  Page 

Drift  Angle 

Deg 

Analog  RecorderAnstructor 

Console  Page 

Turn  and  Slip 

Needle  and  Ball  Pus. 

Instructor 

Console  Page 

Vertical  Velocity 

Ft/Min 

Instructor 

Console  Page 

Airspeed 

Kt,  Observed 

Kt,  Calibrated 

Pilot 

Instructor 

A/C  Gauge 

Console  Page 

Torque  (1  and  Z) 

Percent 

Instructor 

Console  Page 

Altitude  (Baro.) 

Ft 

Instructor 

Console  Page 

OAT 

Deg,  C 

Instructor 

Console  Page 

Time 

Sec 

Pilot 

Hand'held  Stopwatch 

Wind 

From  Deg  Mag/Vel,  Kt 

Instructor 

Console  Page 

Nh 

Percent 

Instructor 

Console  Page 

N,  (1  and  2) 

Percent 

Instructor 

Console  Page 

Parameter 

Characteristic 

Recording  Device^ 

Output  Device 

N ( 1 and  Z 1 
g 

Percent 

Instructor 

Console  Page 

T,  n and  2) 

•3 

Dng,  C 

Instructor 

Console  Page 

Gross  Weight 

Lb 

Instructor 

Console  Page 

Fuel  Load 

Front 

■'‘enter 

Aft 

Lb 

Instructor 

Console  Page 

External  Stores 

Lf>aded/ Unloaded 

Instructor 

Console  Page 

Long.  CC. 

In. 

Instructor 

Console  Page 

T/R  Power 

Ft-Lb 

Instructor 

RMM 

M/R  Power 

Ft-Lb 

Instructor 

RMM 

Control  Force 

Lb 

Pilot 

Hand-beld  Force  Gauge 

Fuel  Flow  (1  and  2) 

Lb/Min 

Instructor 

RMM 

NOTES:  (1) 


(2) 

(1) 


Analog;  U»»r(>rd»*r  wirml  directly  to  coinput**r  D/A  output  sourc»?  for  on-sreno  analysis.  FM  data  tap** 
rororder  connPct#*d  to  samp  sourcp  for  making  pnginporint^  units  tapp  fas  rpquirpd)  at 
NAVAIRTESTCEN  CSD. 

Rprootp  Mpmory  Monitor  (RMM)  ran  bp  uspd  to  monitor  any  paramotpr  in  th«*  program. 

All  simulatpd  mstrumpnts  arp  calibratpd  and  rijppt  at  Jpast  aircraft  standards.  Each  gauge  will  be 
checked  and  vprifipd  against  commanded  computer  value.  Cockpit  parameters  may  be  taken  from 
console  page  to  eliminate  gauge  error  and  for  simplicity. 
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SECUHE,  MULTIPLE-SHIP  OPERATIONAL  EW  TRAINING 


DAVID  L.  ADAMY 
Antckna,  Incorporated 
Mountain  View,  California 


INTRODUCTION 

It  is  now  possible  to  [x-rforni  realistic, 
multiple-ship  area  EW  defense  training  for  a task 
force  of  ships,  or  even  a full  fleet,  without  trans- 
mitting threat  signals  and  without  going  to  sea. 

The  principle  involves  the  use  of  on-board 
threat  simulators  and  radar  target  simulators 
which  reproduce  a full,  dynamic  multiple-threat 
environment  and  are  controlled  and  synchronized 
from  a single  command  jxisition  via  narrowband 
radio  link-s.  The  individual  ships  can  bo  in  port, 
or  underway  for  reasons  totally  unrelated  to  EW 
training  during  the  exercise.  The  simulators 
alK)ard  each  ship  reproduce  the  signal  and  radar 
environment  as  it  would  be  seen  by  that  ship, 
including  consideration  of; 


• All  types  of  threats  (ships,  aircraft, 
missiles). 

• Friendly  emissions. 

• Modulation  and  antenna  scan  characteristics 
of  each  signal  reproduced. 

• Range  and  azimuth  of  each  threat  relative  to 
that  individual  ship. 

• Appropriate  changes  in  the  modes  of  threat 
signals  as  functions  of  time  and  distance 
from  the  ship. 

• Maneuvering  of  the  ship  on  which  the  EW 
receiver  and  radar  equipment  is  located. 

A multiple-ship,  multiple-threat  simulation, 
such  as  that  shown  in  simplified  form  in  Figure  1 


Figure  1.  Relative  Ifireat  Position  Diagram 


223 


.(ii.iK/ril  In  .1  i i'ininiliT  to  thi'  imiini'nt-liv- 

iiH'M'.i'nt  cm  i ri'Mitiriil  limn  llic  |Kunl  nl  vie" 

cl  c.n  li  III  till  -lii|is.  I he  ‘'hi|i'.  .mil  Illic  it'^  arc 
irmcil  .11  ic. ill-tie  r ite-,  iinl  the  -iniial  eiivirmi- 
ineiil  I . f I .iii.i!  v.-eil  clleii  einnitth  In  |il'ini(le 
!i  .ill  li^  iKii.iiiiie  pel  lorinaiiee  mi  Ihe  ili-pla\s  nt 
tl  I I \\  ei|iiipineiil  in  the  -hip'-. 

\.itur  ilU  . Ihe  1,1- 1 1 I nun  mu  missile  ami  air- 
I i:ill  ll  ie.il  -lunal  ■ inii-l  he  npil.ileil  more  olten 
tli.m  ll.i  Icnei  mc\  mu  -hip  I elaleil  th  real  -iunal-. 

Ihe  emnpiilei  llieii  umierates  a simulator 
eon.maml  l as-etle  t.ipe  tor  use  in  each  ol  the 
mili\ iihi.i  1 oii-hoaril  -iiiuilator-,  with  sinehro- 
iii.inu  lili-  maiher-  .it  preest  .ih  1 i shed  points  in 
the  prouram  to  simplili  lati’r  s\  iiehroni/alion  ol 
the  siimilation  mi  Ihe  iinlivnlii.il  ship-. 


The  same  steps  are  applied  tc  the  ariaJvsis  ol 
ol  the  radar  resiMiiises  as  seen  In  each  ship,  and 
Ihe  apiiropriate  radar  laruet  eoniinands  are  added 
to  the  threat  -iunal  seenario. 

laieh  remote  -iiniilator  then  ueiieiale-  ils  out- 
put -iunal-  and  di-plais  in  re-pon-e  to  these 
eommands  n-inu  it-  own  ea-'.etle  tape  plaver,  so 
no  threat  -lunals  n<-ed  to  he  i raiismitted.  ( ini', 
eonirol  and  periodic  -sni  hionii'inu  -iunal-  foi  the 
tape  plasers  need  he  sent  1 rmn  Ihe  (cnlral  eonirol 
station.  Since  the-e  -iunals  aie  nil  rins iea I h 
na I'l'owhand  and  are  lormalted  lor  lull  emiipatihil- 
itv  with  am  amlio  link,  thev  can  he  easiK  sent 
over  existinu,  secure  ship-lo-ship  radio  links, 
or  mer  eahle-,  or  even  eotnnierei.il  telephone 
eireiiits  il  desired.  Further,  since  the  control 
-iunals  are  not  phase  eritieal,  lhe\  can  he  sent 


I lum  e .Multiple  Cooperative  Station  Siiniilator  ( 'mil iuu i alimi 
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(i\i  r satrllili'  link'-  to  nllow  (■i><i|>cr:il ivc  traiiiint; 
lit  I W iipi ■ratin''  oil  wnli'h  '■n'lri rated  'itii|i''  \siOi- 
iiiit  am  iii  tloriiiatu  e ilenradaliini. 

Iteeaii^e  tile  threat  and  nianeiivei  'o  eiiarin  ''een 
111  eai  h lit  the  pa  rt  iei|iatinp  -hips  retleet'  the 
-a me  -itiiat  inn  1 1 mn  dil  le  i eiit  point  • ot  lieu,  all 
III  pa  It  ie  ip.it  inj;  in  the  ''ame  i \erei'i  and  ean 
lieitorni  the  iiorinal  I'ln  rational  n \Kirlinvi,  liuu - 
lioii'.  It  the  lull  -1  ena  rill  1'  ill -plai  ell  III  an 
in-tnii  Ini  hi  a minieninputi  i i -in  h a--  the 
AN  IA'K-L’ii)  at  the  eiiiilrnl  'lalinn  he  ean  -.1  ni  i 
thi  IMI'I'I  in  I'll  linn  ''i  enm|ia  1 inr  I In 
1 1 [ml  ti  il  inl"i  mat  ion  and  eoiielu  ■ 1011  - iiith  tin 
iitiial  iliialnin  1 epn  'enled  In  the  exerei'e 
'I  I na  rii 

I III  "IMI  1 \ 1 1 'll  ''1  KM 

I mine  ^ hnU'  the  lull  iliiiilalni  -1  -tern, 
nil  hnlinr  a ■ iiipli  iiai'lei  eoiilml  --10111111  and  a 
iiumlii  r 11!  lemnli'  '-imulatnr  'ilatioii'-  on-lioard 
mill  1 iiliia  I pa  1 1 II  I pat  ill"  -hip-' . I mill  tin-  I mil  1 e , 
it  Mill  he  Hilled  th.il  twn-iiai  eiimiminieation  niii-t 
e\i-l  hetiM  en  eai  h ol  Ihe  pai  lieipal  inn  ■^hip-  and 
the  ma-ter  entitrnl  -tatinn. 

I hi-  allow-  u-e  ot  a niaxiiiiallv  ell'ieienl  '11011- 
ledundant  " eomniand  -eheiiie  h\  a-siirinn  that 
eai'h  ((iiiniiand  sent  i-  received  propel  1\  1>\  it- 
inleiided  remote  -\-tem  ithrounh  an  aiitoiiiatie 
ael  now  ledni'liient  teehniijiiei.  Al-o  noli-  that  -in- 
luil-  to  reiiiole  -iimilalor  ei|iiipment  on  hoard  the 
-hip  111  which  the  nia-tei  eonirol  -tation  is  Ineated 
•lie  eonnei  ted  to  Ihe  eoiiiinand  -tation  hv  i aide-. 

\-  will  he  -een  helow  , tin-  tec  hnii|ne  doe-  not 
leijiiiti  -everal  dedii  ateii  link-,  hut  can  il-e  a 
-innle  net  I reijiieiiei  lor  Ihe  whole  e\eii  i-e;  the 
alne  net  can  he  ii-ed  tor  \oiei'  eoiiimiinieat  1011 
i,illhoii^;h  -Oinewh.il  deaiadedi  in  one  ol  ihi- 
Opel  atmn  liiiide-  . 


MA.^t'l  KH  ('(IN  I Hdl,  STA'I  l<  i.N 

The  iiia-ter  eontrol  slalion,  a.s  -hown  in 
I'iHiire  d,  eoinpri-e-: 

• \ iiia-ter  eontrol  eonsole  on  which  the 
in-l  1 III  tor  pla\  - a tape  to  eontrol  the 
ea-'-elle  platers  at  Ihe  remote  -iiiuilator- 
and  to  -V iieliri lui/e  the  -cenario-.  It  al-o 
allow-  the  instriietor  to  make  real-time 

I h iiitte-  to  the  scenario  lhroiit;h  ke\ hoard 
eominand.- . 

• A link  interlace  unit  which  eoii'verl-  the 

-eiial  output  I rom  the  control  eon- 

ole  into  a lorm  that  can  he  ea-ilv  and 
leiiiialelt  t ran-mitted  O',  or  am  audio  link. 

I here  are  Iwo  st-lem  operatinu  modes  which 
ean  he  -eleeled  h\  the  in-lnielor,  a iiarrowhand 

I le  and  a widehand  mode.  In  Ihe  iiarrowhand 

mode,  the  ma-ter  eonirol  eonsole  outputs  data  at 
.'ion  hit-  per  second;  onh  recorder  eontrol 
eommaiids  are  passed  to  Ihe  remote  simulator 
-vslem-.  These  eommaiid-  inehide: 

• Start 

• Slop 

• llewind 

• do  to  tile  mimher  X.N  iloo  tile  inimher- 
aiailahlel. 

In  Ihi-  nioili  , the  link  interlace  unit  output.-  a 
narrow  hand  t iii-(  >1 1 l.e\  ed  |C  ic  iK  1 siamil  :it  djoo  \[/ 
I his  -ittiial  i-  hi"h  pa--ed,  -o  that  low-|ia--ed 
mice  -iuiial-  can  he-  mixed  with  the  eontrol  -ignal 
on  the  same  voice  "lade  link  il  desired.  Iteeause 
III  the  narrow  handwidth  ol  the  eontrol  -i"nal-  in 


to  SECURt  LINK 
fHANSCf  IVFR 


ACKNOWIEOGE 
COMMANO  TONES 


1 inure  :i.  .Master  t'ontrol  Station 
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Ifu  ii.i rum ti.iiiil  ini"/c,  si^n.i/'  inii't  lie  ■<<"11  .it  .1 
\i  t\  low  iMtr  1 .1  Ilhoni;ll  .l<U‘<(U.ltl-  lo|  control  .111(1 
111  In  oMi . .1 1 loll  ol  till-  -'Ci  ii.n  10-  I lint  tin-  ii.i  1 row 
li.iiiC  ' I'llli  .lUo  .1II0W-.  tin  -iciii  to  woi  U to  lull 
|.i  I |oi  iii.iiii  c c\ cii  o\  I 1 vir\  |« 'or  i|u.i  I it  I link''. 

\11  ol  tin  .u  tiuil  ~i|;iiiil  |i;i  rimictci  nr  laii;ct  |ki-i- 
lioii  il.it.i  |i.iv'.imI  to  the  "liiiiikit  loll  cinii|i|iiriit  III  tile 
11,1 1 row  Ii.i  11(1  mode  m ''torcil  on  l.iiic-.  it  the  rcniotc 
li '(  lit  ii  '11"  . 

In  the  wiilcli.iiul  mode,  tile  iimlnietor  im  an 
on-line  eomi'iitei  1 ( .111  u»'iierati  eiiiiitiiand."  whie/i 
will  diii  i th  ,ilt(  I till  "innal  paranieteis  ont|iiil 
In  till  ii  iiioti-  ~ j mu l.ito  1"  . Ill  till"  mode,  tile  link 
iiiti  rliiei-  unit  eoiuert"  the  "erial  data 

into  a liei|iu'ne\  "hilt  ke\  ed  il'SKi  "i[;ti:il  lor 
1 ran"iii  1 "ion  to  the  remote  "imulator"  o\et  the 
voiee  made  link.  Since  the  I'SK  "inual  oieU|iie" 
1110-t  III  the  liandwidth  ol  a \ni(  e i;i  ide  i h.innel,  it 
eannot  "li.ire  the  ehaiiiiel  with  voice  "ittnal"  ii" 
de"erilied  toi  the  n.i rrow liaiiil  mode. 

Both  modi'"  would  I'loii.dilv  he  U"e(l  dii nun  aiiv 
-oit  ol  Irainintt  o|ieralion.  hut  m a "hurt  term, 
hitthh  dvnaniie  iiroldem  1,1  h.ittle  "cenario  lor 
e\.ii'  I'll  ■ the  "\"tem  would  lie  in  the  narrow -ha ml 
n ode  mil, I ol  the  time  with  the  instnietor  "Witeh- 
lli'a  into  the  wideh.ind  iiioile  |oi  hriel  |ierio(l"  to 
ehanite  "ome  p.i  1 an.i  ter  tm  a "peeitie  reason. 

I'oi  loiraei  tenii  proldeiii"  1 to r exa inple , a inediuiii 
aetivdv.  Jl-hour  proldemi  the  widehand  iiio.le 
mit;ht  he  used  nio"I  ol  the  tune  with  eoniiiiand" 
eon. inn  direetlv  Iroiii  an  on-line  eoiiiputer  to 
provide  inaNiiiuiin  llexihilitv  to  the  prolileiii. 

In  eitlier  mode  the  HS-Jd-  data  eonies  Iroiii 
the  eontrol  eon"ole  in  "erial  lorin,  and  is 
eolleeted  hv  the  link  interlace  unit  into  loniiatled 
output  words  with  "Vnehroni/inn.  address,  and 
imritv  hits.  When  the  eoiiiliiand  words  are 
received  hv  the  remote  simulator  "Vsteiii  or 
sv"tems  to  which  thev  are  addressed,  loded 
ai  know  lednenient  tones  are  sent  hack  to  the 
master  station  link  interface  unit.  II  no 
aekiiow  lednenient  tone  is  received,  the  eoniinanil 


word  IS  sent  anain  until  the  piopei  aiiswerinn 
tone  I ident il V inn  Ihe  addressed  remote  "v  sleini 
i"  received.  II  .1  eomniand  is  not  properlv 
received  and  aeknow  ledned  within  "»  "ceoiid",  the 
svstem  ni'lilie"  the  iimtnietoi  that  one  o|  thi  link" 
I"  out.  Since  seenre  links  otten  drop  out  suddenlv 
with  los"  ol  sv  Hell  roll  I /at  ion  ol  enervptei'",  thi"  is 
.111  imiKirUiiit  leature  ot  the  svstem. 

1 he  de"inn  (i|  the  link  interlace  e(|Ui|inient 
allow,  the  svsleni  to  operate  aeeuralelv  with 
virtu, (111  am  level  ol  sijpia l-to-iioise  ratio  in  Ihe 
eoininunieation  links  used  to  transmit  .iiiil 
aekiiow  ledne  eoniinands.  .\  denraded  link  will 
(list  re(|Uire  mori-  and  more  repeated  eoinmand" 
as  Ihe  'ittnal-lo-noise  ratio  drops;  hut  since 
multiple  paritv  hits  are  cheeked,  no  lake  eom- 
mands  will  he  accepted  hv  the  remote  "vstems. 

'I  his  creates  a nraeetui  denradation  ol  perlorni- 
anee  with  link  den radation. 

i<i;m(  I I I-:  si.Mi  i.,\ k ih  s'i  s i i m 

I'iniire  I is  a hloek  dianram  ol  one  o|  the 
remote  simulatoi  sv 'li-iiis  . Ihe  Link  Interlaie 
knit  111  this  "Vslem  receive"  and  demoduLite"  the 
I SK  or  I It  iK  "inn.il"  I rum  the  master  control 
"lalion,  cheek"  the  paritv  hit"  to  delei  mine  that 
the  "innal  wa"  eorieetiv  reieived,  and  send"  .1 
properlv  coded  aeknowleilneini'iil  lone  hack  to  the 
master  eont  nil  "t.ilion.  It  .iko  sep.iiales  the 
low -passed  voiie  i hannel  1 1 0111  tin  i onimand 
"inn;il"  il  the  "V"tem  i"  in  the  narrowh.ind  mode. 

In  a nai  row  hand  operation,  the  eontiol  "innak 
no  to  Ihe  eassi  ite  l.ipi  pl.ivei  which  then  eontrok 
Ihe  "innal  "iliiukitoi . In  v ideh.ind  operation, 
"innal"  are  passed  direvtiv  to  the  "inn.il  "iimikitor 
to  modilv  "innol  parametei". 

Ihe  "innal  "imukitoi  suhsvsliiii  nmerates 
lai'ne  numhers  ot  "imull.ineou"  "inii.ik  which  ire 
coupled  into  Ihe  input"  ol  Ihe  "hiplKi.nil  1 W e<|Uip- 
melil  so  that  the  ei|Uipmeiit  i;in  receive  Imth  its 
nortnai  input  "innal"  vtrom  it"  .ifilennasr  and  the 
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m'liriiJlfd  nil  iKiiiril.  '1  hr 
-m  ul.ilni  iKii  mil ■rlarr'.  wilti  Ihi-  anti  iina  ciintinl 
■~\  Ml  ti r< I ■'V  - li-m  In  I'l  n\  nil’  I i-al  I '1 11  -'I  muilal  inn 
nl  111!  ilin  i'lmn  limlmn  Inmlmn'  nl  Ihr  I \\ 

1 qiiipmi'nl . A I 111  III  I uni  I mil  |iii  Innin-il  In  llm 
-lun.ll  -IllUll.llnl  l~  llli-  |;i  ni  T.ll  lull  nl  llm  i nllllnl 
ii.n.il-  1 1-1(111  ii  il  In  ili-.|ila\  --inuilati  il  laii'.i-t-'  "ii 

• '111  ni  iimri-  lailai  I’I’I  ‘-in|ii-'-. 

-K  N \ 1 SIMI  1 A 1 I iH 

llm  ''i(;nal  'iinnlalni  iHiilmii  n|  Dm  n-iimlc 
-.\-.ii  in-'  ai  lualh  ui-imiali  llm  lil  cin  i mniimnl 
■.i-i-n  li\  Dm  1 W i-inninimnl  anil  Dm  ii-luni  linaui-M 
nl  Dif  lailai  I’lM  '-in|ii-'^  nn.lH>aiil  Dm  iniliinlnal 
-lulls  Uikint;  |>ai1  in  Dm  training  i-m  la  i-i-,  a- 

• hnwn  111  l■■inll^l■  n.  li  inni|iri-i--  |iul-i-  -can 
;,cnci  ami  - , Hi'  -^cimi'aliir  nimliilalni  - , an 

anli  nna  -umilalor.  anil  a railai  lai-cci  -iiimlatnr. 
Ilii-  -iili-v  -tcni  i-  niailc  U|i  nl  -laml.ml  C.SA- 
li-lcil  -iiiuilaimn  cqii i|inunl  ii  r\  -iniilai  In  Dial 
ii-cil  in  Dm  7Hl  Irainmi;  lai  ilil\  al  Ncu  l,nnilnn 
i-i  I rinaiii-iii  anil  in  llm  I nA  d laiilili  al  I'l-arl 
llailini  i-cc  ri(;iirc  Ti  uliich  haic  In-cn  in  u-c  lor 
ni.l  i .'i  \cai-  uillia  '.'s  |ii  ii  cnl  .iiail.ilnliu  la-cnnl. 
IlnncM-i,  Dm-c  iinil-  will  In-  -i  lcilcil  linin  Dm 
imui  -I  |■inll^ml  him-,  wliicli  In  u-c  nl  ncn  ili'-i(;ns 
aiiil  inin|inncnl-  cciii  lalc  -innil  ii  anili  lii(4licr 
ili-n-iU  cin  i rnnnicnl-  ii-iiin  Icuci  innilulc-.  I hc\ 
nill  .il-n  he  I rnin  Die  iiiMMi  -ci  ic-  (Kirlahlc  ilvnainic 
>iiuul.tlni  h.irilnai'c  line  In  nial.e  Du-in  emniialihle 
with  -liiiiln  la  I il  niie  lal  mil . iSee  I i(;uie  -.  i I lu- 
ll hnie  -iih-i  -tc-in  i-  iimiliilai  .mil  (-an  )<i-ni  nli-  an\ 
ile-iieil  -i^nal  il»-nsil\  In  Du  ailililinn  nl  eqiiii'- 
lueiil  nmdule-. 

I lu-  |iul-e  -i  an  neneralnrs  i l eale  main  |)ul-e 
-inn.il-  111  re-|Kinse  In  Du-  i ninniand-  ia-i(-ii(-d 
Irnin  eiDu-i  llm  ea--(-lte  (ilaii  i mill  nr  Dm  link 


iiili-ilaee  unit.  .AH  -iunal  |)aianu-l(-r-  an-  stnn-d 
111  a d(-dieali-d  nienmi  i eiri-iiit  In  (-a(  h KCiu-ratni 
-n  (-niniiiand-  lu-i-d  he  mien  null  In  elianui-  |iaiani- 
i-li-r-.  I aeli  neiu- rali-d  -innal  ha-  a iini(|Ue  (iiil-i- 
nuuliilalmn  and  si-aii  i ha  t ai-lei-j-l  ie,  hiil  the 
-innal-  are  inli-rleaied  nn  a |iul-e  In  [iiiksf-  ha-i-, 
nnin  a -illKle  -el  nl  nut|)Ul  liiu--.  In  allnu  Die 
illK-rleai a-d  |)uls(-s  In  he  snrted  mil  hi  the  nthei 
ei(ii ipiin-nt  in  Du-  -inuilatnr.  a -et  nl  paralh-l 
(iirreul  larn(-t  addre-.-  (C'lAi  liiu-s  are  pi-niided 
In  jdentili  i-ai  h piilsi-  mill  the  -innal  tn  iihieh  il 
heinnr;-. 

■|  he  HI-  H(-imralnr  iimdiilatnr-  ra|ndli  tune  in 
Du-  enrrei-t  HI  lre(|U(-iK-i  tor  ea(-h  nl  Du-  -lunal- 
nn  .1  |iiil-e  hi  |iiil-i-  ha-i-.  1 lu-  |iul-es  an-  atti-ni,i- 
al(-d  In  iirni  id(-  Du-  i-nri  ei-l  -(-an-i-elaled  signal 
lei(-l  Inr  i-ai-h  piil-i-,  and  are  al-n  attenuated  In 
-iinulali-  the  i-Di-ct-  nl  reeeiiiiin  antenna 
iminlinn.  CW  -ittnal-,  il  r(-((Uired,  are  ni-iu-raled 
III  the  HI  i;eiu-ratnr  inndulatnr  -iih-v-ti  ni  and 
an-  indept-iulenlli  nindulali-d  iiith  llu-  reeeiinin 
anleiina  ( ha raek-ri-tie-  Imlnn- heiiif;  -iiinnu-d 
11  ith  tiu-  |iiik-e(l  -ij^nal- . 

l lu-  ii-e(-iiinn  anl(-nna  alU-nuatinn  laetni  - ar(- 
prniid(-d  hi  llu-  anl(-nna  -inuilatnr  unit.  It  di-li-r- 
inine-  llu-  anii-nna  |i<dnlinn  an^U-  hi  -(-nsinu  llu- 
lii(--iiin-  siiu  hrn  (-ntilnd  niil|iut.-.  Sinci-  tIu-  (-nr- 
r(-(-|  a/iniulh  nl  arriial  nl  (-aeh  nl  llu-  -inuilat(-d 
-innal-  I-  -Inri-d  in  a nii-iimri  t-in-iiil  in  tlu- 
aiit(-niia  -iniulainr.  it  i-an  (-ah-uiali-  Du-  anuli-  "ntl- 
nl  l«>r(--iuhr'  Inr  (-a(-h  pul-e  nl  a -iipial.  and  can 
a(i(dv  the  (-nj-re(-l  alh-niialmii  lai-lnr  iineludinn  tlu- 
elti-i-l  nf  anii-nna  siiU-Inlu-sl  In  llu-  (-niilrnl  liiu-  Irnni 
iihieh  llu-  HI'  neimiatnr  nindiilalnr-  di-rii(-  their 
inlni'inatinn. 

'llu-  radar  lai'ci-t  siniiilatnr  aeei-pt-  i-nniiuand 
data  Irnin  the  i-assi-tle  rt-ennh-r  nr  link  inl(-rla(-(- 
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unit  tlinnigh  th»-  datii  intorfat-t'  cirt-iiitry  in  tho 

Scan  ncncnitor  c<(vi)pnicnt.  II  (icncratcs  all 
(if  tlic  ccintnil  si^cnals  necessary  tn  display  simu- 
lated tai-Kets  on  a slave  I’l’l  radar  sco|H‘  such  as 
the  one  shown  in  Kiirure  ;•  (part  of  lOA.'t  Simulator). 
Since  the  [ilacement  and  simulated  radar  cross 
section  of  these  tarjtets  is  coordinated  with  the 
tlireat  sipial  djita  commands  to  the  K\V  sijoial 
simulator  units,  the  K\V  personnel  involved  in  the 
exercise  ftet  a fullv  coordinated  picture  of  the 
liattle  scenario  as  it  unfolds. 

KXl'.ANSION  OK  BASIC  CAPABIU  H' 

The  simulation  thiLs  far  described  has  related 
only  to  surface  ships,  but  it  is  easily  extended 
to  include  submarine  platforms.  The  only 
difference  here  is  tliat  the  simulated  signals  must 
be  intermiited  during  any  time  the  submarine  is 
submerged  (either  actually  or  in  simulation  if  it  is 
not  at  sea).  If  the  subniarine  is  actually  under- 
way during  the  exercise,  a slight  modification  to 
the  commanding  scheme  must  be  made  to  allow  an 
u|Klate  dump  of  commands  to  the  submarine  on 
demand.  This  allows  the  simulator  in  the  sub- 
marine to  be  u|xlated  to  include  any  parameter 
changes  which  might  have  fxien  sent  while  it  was 
submerged,  and  hence  had  its  communication 
link  interdicted. 

EW  aircraft  can  also  be  added  to  the  problem, 
since  flight  line  ec|uipment  capable  of  stimulating 
the  aircraft's  EW’  equipment  and  compatible  with 
the  multiple-ship  simulation  configuration  Is 
also  available.  However,  at  the  moment,  this 
equipment  can  only  be  used  with  the  aircraft  on 


tile  ground  (or  carrier  deck)  since  it  is  not 
designed  to  be  carried  alxiard  the  aircralt. 

CONCl.lSIONS 

With  the  introduction  of  the  Area  KW  delense 
management  concept  and  its  increasing  inqior- 
tance  in  modern  warfare,  it  is  becoming  ever 
more  im|H)rtant  to  provide  EW  operators  with 
realistic,  cooperative,  multi|)le-ship  training  in 
the  search  for,  identification  :ind  location  ol , and 
proper  reaction  to  tlireat  signals.  Kurther,  it 
must  be  provided  in  the  most  cost  effective  way 
possible;  so  it  can  be  repeated  often  enough  to 
achieve  not  only  competence  but  excellence  of 
performance  by  EAV  o[K-rators. 

The  presented  concept  is  a classic  example 
of  resource  conservation  through  simulation, 
since  the  cost  of  installing  this  type  of  remote 
simulator  system  on  a ship  is  less  than  the  cost 
estimated  by  the  Office  of  the  Chief  of  Naval 
Operations  for  taking  that  same  ship  to  sea  for  a 
single  l-week  exercise.  Kurther,  this  concept 
allows  EW  and  radar  operators  to  be  cooperatively 
trained  under  high  density,  "hot  war"  engagement 
conditions,  with  large  numbers  of  friendly  ships 
maneuvering  against  large  numbers  of  enemy  ships 
which  are  firing  anti-ship  missiles,  and  large 
numbers  of  enemy  aircraft;  conditions  that  can 
(in  peace-time)  only  be  created  through  simula- 
tion. Therefore,  this  simulator  based  training 
is  not  only  less  expensive  than  that  which  could 
be  provided  by  maneuvering  ships  against  emitting 
signal  sources,  but  its  i|uality  and  realism  are 
superior. 
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The  Variaf'lc  Coehfit  Tr  ii  n ?’ na 
."yafe’"  i >t  uae  at  the  V.  .7.  f'oael  iuai'd 
Avitti  n Trazniaa  CcKter  zk  Mof’Z.fe, 

A I z'z  zr.'z  T'epreeeKtp  iz  drantie  de\ar- 
••.<re  T'ro’^  tradi  t zonal  •nzlitar-j  pilot 
traininz.  Throuah  the  use  of  z ht\zhln 
r h ' e ‘ 'ztea  flijht  ninulat  e and 
aet’ez’zl  zdtzzneed  t raininj  te  ohi  nq'aeo 
the  "oazzt  luard  hze  realixed  drazriti'' 
eavz'nza  in  both  tz'aining  ti’ne  and 
train' ng  •'ostzi.  In  addition,  tho'a- 
ezndiz  of  airTaft  ho’arr  pz'e'Jz -"ue  ly 
ui'cd  ! '!  training  have  keen  released 
f r 'ase  in  other  Coast  Tuard  mir.e-'ons. 

■ ' re  f the  *ic'j  te  ehni  zves  'Jere  'used 
in  a z ure  aircraft  te  lining  pro  zrar 
i ri  r to  the  delivery  of  the  niru'a- 
tor.  This  all-<'Aed  tie}  ante,  anilyris 
f tz  ivi  n zs  ierived,  fz-  r 'e.rt  j f zee  t s 
f the  ! rograr. 

BACKGROUND 

In  1973,  the  Coast  Guard  beqan 
usinq  a helicopter  traininq  system 
incoriJoratinq  a sophisticated  simula- 
tion facility  and  many  advanced 
traininq  concepts  never  before  imple- 
mented in  an  operational  military 
fliqht  traininq  proqram.  Three  types 
of  traininq  are  provided  at  the  Avia- 
tion Traininq  Center  at  Mobile,  Ala- 
bama. Each  year  proficiency  traininq 
is  provided  for  all  Coast  Guard  heli- 
copter pilots  in  the  HH-3F  or  HH-52A 
simulator  to  renew  their  instrument 
ratinq  and  provide  realistic  emorqen- 
cy  procedures  review  never  before 
available.  This  entire  course,  in- 
cluding the  instrument  checkride,  is 
given  in  the  simulator.  Coast  Guard 
pilots  with  rotary  wing  experience 
who  are  to  be  trained  in  the  specific 
helicopter  go  through  the  Transition 
course.  This  involves  training  in 
the  actual  aircraft  as  well  as  the 
simulator.  The  Qualif ication  course 


prepares  fixed  wing  pilots  for  their 
rotary  wing  ratinq  in  the  HH-52A. 
This  also  involves  both  aircraft  and 
simulator  traininq.  We  will 
discuss  our  first  four  years  experi- 
ence with  this  system,  with  emphasis 
on  design  features  of  both  the  sim- 
ulator and  the  training  program. 

Before  we  discuss  our  new  sys- 
tem, we  will  review  traditional 
military  pilot  training  to  show  the 
frame  of  reference  from  which  the 
Coast  Guard  approached  this  new 
von  ture . 

Traditional  Subject  Matter  Emphasis 

Prior  to  July  1972  all  Coast 
Guard  helicopter  pilots  were  trained 
using  the  conventional  method  of 
training,  i.e., learn  aircraft  sys- 
tems in  great  detail  through  an  in- 
structor who  stood  up  and  lectured 
on  the  material.  Flying  the 
helicopter  was  not  begun  until  the 
entire  lecture  series  was  completed. 
This  was  true  of  undergraduate  pilot 
training  with  the  Navy  as  well  as 
transition  or  qualification  training 
which  was  conducted  by  the  Coast 
Guard . 

Traditional  Instructor  Selection 

As  anyone  who  has  attempted  to 
do  a research  project  in  a routine 
pilot  training  program  will  tell 
you,  the  greatest  source  of  variance 
in  the  way  students  are  trained  is 
the  instructor  pilot.  To  partially 
counteract  this,  standardized  brief- 
ings are  devised  for  each  maneuver 
so  the  student  will  i.ot  be  penalized 
for  having  an  instructor  who  can't 
communicate  his  thoughts  as  well  as 
another.  In  many  cases  instructors 
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lire’  chosen  not  for  their  ability,  but 
for  their  a va i 1 ibi  1 i ty . Frecjuently 
qraduatinq  students  are  chosen  to  be 
fliqht  instructors.  Students  usually 
qe’t  their  choice  of  assiqnmeints  ac- 
cordinq  to  their  class  standinq. 
rriori  tie’s  are  usually  arranqod  simi- 
lar to  this;  fiqhters,  bombers, 
transports,  he»l  icopters , desk  iobs, 
and  finally  (quip)  instructor  pilots. 

T rji d itional  Flight  Syllabus 

In  order  to  ensure  adequate 
cove’raqe  of  all  pilot  skills,  a 
strict  syllabus  was  devised  which  in- 
structors were  expected  to  follow  as 
accurately  as  jxissiblo.  This  t)ior- 
ouqli  outline  of  how  traininq  time 
was  to  be  spent  was  developed  pai — 
tially  in  response  to  a ree^uirement 
for  each  class  to  finish  on  a preset 
date.  Traininq  commands  were  re- 
cjuired  to  turn  out  a qiven  number  of 
pilots  at  qiven  intervals.  In  order 
to  comply,  they  had  to  have  a pretty 
accurate  picture  of  such  thinqs  as 
the  rate  of  attrition,  weather  delays, 
and  aircraft  availability.  From  the 
command  point  of  view,  followinq  a 
riqid  syllabus  reduced  the  variabili- 
ty due  to  individual  learninq  rates. 

It  is  important  to  note  that  the 
Coast  Guard  pilots  who  worked  in  de- 
velopinq  our  present  traininq  proqram 
wi-re  products  of  traditional  military 
traininq  proqrams.  It  was  at  times 
difficult  for  them  to  override  their 
concepts  of  what  a military  traininq 
proqram  should  be  like. 

The  first  break  with  tradition 
came  in  choosinq  the  officers  to 
serve  as  Coast  Guard  instructors. 

When  the  Traininq  Division  was  first 
established  in  1965,  a decision  was 
made  to  select  instructors  from  op- 
erational pilots  who  first,  wanted  to 
be  instructors,  and  second,  were 
known  to  have  the  basic  skills  and 
[lersonality  to  be  qood  instructors. 

By  the  time  this  new  traininq  system 
was  conceived  there  was  on  hand  a 
qroup  of  hiqhly  motivated,  hiqhly 
respected  instructors. 

Still,  there  was  a reluctance 
on  the  part  of  the  instructors  to  de- 
velop such  a radically  different  pro- 
qram as  was  envisioned.  Their  arqu- 
inents  can  be  summarized  in  two  cate- 
qories:  First,  they  noted  the  pre- 

sent system  had  been  successful  for 
years  and  saw  no  reason  to  chanqe; 
and  second,  in  most  cases  those  who 


had  experience  with  simulators  felt 
it  had  been  a bad  experience  with  no 
real  traininq  value. 

DEVELOPMENT 

In  1969,  the  Commandant  request- 
ed a study  of  Coast  Guard  aviator 
traininq  requirements  to  determine 
whether  traininq  costs  could  be  re- 
duced by  usinq  advanced  traininq 
technoloqy.  This  study,  conducted 
by  HumRRO,  included  a task  analysis 
of  o|Xjrational  pilots  in  each  Coast 
Guard  airplane.  (Hall  et  al.,  1969) 
It  was  determined  that  a revised 
traininq  proqram  takinq  advantaqe  of 
new  concepts  and  technoloqy  could 
reduce  traininq  costs  considerably 
and  increase  overall  traininq  effec- 
tiveness. (Caro  et  al.,  1969)  The 
decision  was  made  to  develop  a 
Variable  Cockpit  Traininq  System 
(VCTS)  for  both  Coast  Guard  helicop- 
ters. 

From  its  inception  in  1969,  the 
VCTS  was  thouqht  of  as  a fliqht 
traininq  system  which  had  a sophis- 
ticated simulator  as  an  inteqril 
part,  rather  than  as  a simulator 
which  miqht  be  squeezed  into  an 
existinq  traininq  proqram.  Desiqn 
features  of  the  simulator  wore  eval- 
uated on  the  basis  of  traininq  value 
[ler  dollar.  As  a result,  we  have  no 
visual  system  which  may  have  saved 
no  more  than  two  hours  per  student 
qiven  the  state  of  the  art  at  that 
time.  Six  deqrees  of  motion,  on 
the  other  hand,  wore  considered  in- 
dispensable because  of  the  cues  pro- 
vndixl  for  many  of  the  malfunctions. 

Primary  contracts  were  eventual- 
ly let  to  Refloctone,  Inc.  to  build 
the  simulator  itself,  and  to  HumRRO 
for  assistance  in  developinq  tne 
traininq  proqram.  An  additional 
subcontract  was  .at  to  .JAVTkALiJL  Il’CEN 
for  tectinical  expi  rtise  in  devidopinq 
ttie  specs  for  Llie  simulator. 

Traininq  Prog  ram  Features 

Fliqht  instructors  were  active- 
ly involved  in  developinq  the  train- 
inq proqram  they  were  eventually 
qoinq  to  use.  Three  instructors 
from  each  aircraft  were  qiven  pri- 
mary resixinsibi  li  ty  for  creatinq  the 
new  traininq  proqram  with  quidelines 
and  assistance  from  HumRRO  personnel. 
From  time  to  time,  other  instructors 
were  consulted  reqardinq  their  area 
of  expertise.  Each  of  the  three 
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I ns  t riio  t rs  was  assi'rnoci  to  the  P.c-- 
fli’ctono  fai'tor'/  to  assist  in  testing 
and  accept vinco  of  the  new  simulator 
for  about  a month  at  a t i m' . The 
other  two  worked  on  writinq  the 
course  m.itcrial.  This  rotation  was 
devise<i  to  provide  them  with  a total 
picture  for  the  new  pro<iram.  This 
also  reduced  the  problem  of  the  ac- 
ceptance pilot  adjustinq  to  the  s i m- 
ul atoi . 

Sever. il  new  traininq  concepts 
served  as  focal  points  for  the  devol- 
opnxTit  of  the  new  traininq  system. 

As  miqht  be  imaqined,  many  heated 
iiscussions  took  place  before  iinple- 
nu'ntation  of  such  a radical  departure 
from  traditional  fli()ht  traininq.  In 
discussinq  each  of  these  concepts,  we 
will  summarize  som*.'  of  the  problems 
envisioned  by  the  instructors  and 
then  report  on  their  sulisequent  ex- 
[X?  r ience . 

How  to  Operate  the  System 

It  was  determined  that  the 
traininq  program  should  focus  on 
traininq  objectives  that  can  be  eval- 
uated by  observing  student  behavior. 
These  objectives  should  bo  related 
to  tasks  that  a pi  lot  might  be  ex- 
pected to  do  in  the  operational 
env’i  ronment . The  student  should 
know  how  to  operate  the  aircraft 
systems  in  all  normal  and  emergency 
conditions.  He  would  not  need  to 
know  all  components  of  each  system. 

I f he  can't  control  it  from  the 
cockpit,  he  doesn't  need  to  know 
about  It.  The  old  school  flight 
instructors  were  a little  less  than 
enthusiastic  about  this  idea.  Many 
examples  wore  cited  where  a pilot 
had  saved  his  "bacon"  by  knowing  how 
to  jury-rig  an  immediate  correction 
for  a system  problem  based  on  his 
thorough  knowledge  of  the  system. 

This  is  the  most  valid  argument 
against  the  systems  approach  to 
training,  and  it  must  bo  dealt  with. 
The  answer,  of  course,  is  to  ensure 
that  all  conceivable  ways  to  operate 
a system  from  the  cockpit  are  covered 
for  all  conceivable  malfunctions. 

In  retrospect,  this  concent  lias 
been  a groat  time  saver  in  all 
courses.  Traininq  objectives  defined 
in  this  way  have  proved  successful  as 
reflected  in  follow-up  critiques  from 
the  operational  units. 


Proficiency  based  Advancement 

As  soon  as  a student  could 
perform  a particular  operation  at 
.in  acceptable  level  he  should  lie 
allowed  to  move  on  to  the  next  level 
of  difficulty.  This  is  imperative 
when  sotting  objectives  in  terms  of 
expected  behavior  rather  than  ma- 
terial to  be  covered.  When  the  ob- 
jective has  boon  met  the  lesson  is 
complete . 

It  has  been  documented  that 
accoiJtable  performance  to  one  in- 
structor may  not  be  acceptable  to 
another.  (Koonco  1972,  and  others) 
Pinning  down  the  acceptable  perfor- 
mance criteria  for  each  maneuver 
retpiirod  a lot  of  discussion.  These 
ranged  from  very  detailed  to  very 
brief.  The  general  consensus  of 
the  instructors  was  that  recording 
great  amounts  of  detail  was  neither 
retjuired  nor  desired  during  the 
flight.  A form  was  finally  adopted 
which  dealt  in  broad  maneuver  cate- 
gories reejuiring  only  a mark  to 
show  whether  the  attempt  was  "Satis- 
factory" or  merely  a "practice" 
trial.  Additional  detail  could  be 
added  after  the  flight  in  space 
provided.  Tlie  guidelines  for  sat- 
isfactory performance  arc  still 
primarily  subjective,  liowever,  they 
are  validated  as  instructors  rotate 
students  during  the  latter  phases 
of  training. 

Traininq  Managers 

Instructors  were  given  the 
role  of  managing  the  conduct  of 
each  course  they  taught.  One  in- 
structor was  to  take  his  students 
through  the  entire  traininq  pro- 
gram modifying  i t as  necessary  to 
ensure  that  his  students  met  the 
end  of  course  objectives.  He 
would  be  responsible  for  all  phases 
of  traininq  from  study  assignments 
and  systems  information,  to  the 
cockpit  procedures  training,  the 
simulator,  and  into  the  aircraft. 

The  academic  phase  was  integrated 
into  the  simulator  and  flight 
phases.  In  the  later  operational 
phases  the  students  would  fly  with 
other  instructors  to  validate  ini- 
tial training  and  provide  feedback 
to  the  principle  instructors. 

There  was  a general  uneasiness 
among  the  new  "traininq  managers" 
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who  folt  tho  need  for  the  more  eom- 
fortiiblc  guidelines  they  liad  hud 
witli  tile  strict  syllauus  approaca. 
They  were  eventually  made  comfortauli' 
with  a list  of  maneuvers  which  must 
be  accomplished  satisfactorily  before 
mf'vinc)  on  to  the  next  phase.  Materi- 
al previously  presentod  in  the  first 
SIX  lessons  was  collasped  into  "Phase 
One,  Rasic  Land"  with  no  time  divi- 
sions or  sufjqestions  for  how  to  use 
the  lesson  time. 


TABLE  1.  RAVItJGf)  IN  FLIGHT  TIML  U.SING 
AOVANCLU  TKAINING  COWCLPTS 
WITHOUT  THK  S IMULATOK . 

HH-52A  QUALIFICATION  COURSE 


Moan  Aircraft 

Time SD 

OLD  SYSTEM  77.3  3.fl 

NEW  SYSTEM  67.7  3.6 


SAVINGS 


9.6 


Because  the  concept  of  Instruc- 
tor Manager  was  new,  it  was  difficult 
to  provide  tho  instructors  with  de- 
tailed descriptions  of  what  steps  to 
follow  in  sotting  up  an  outline  of 
instruction.  At  first,  groat  care 
had  to  be  taken  that  each  instructor 
did  not  set  up  his  own  mini  syllabus, 
but  rather  used  a proficiency  based 
method  of  instruction. 

As  instructor  managers  gained  ex- 
[lorience  they  became  more  flexible 
in  taking  advantage  of  their  freedom. 
Now  instructors  who  have  come  aboard 
after  the  first  year  are  more  recep- 
tive to  this  idea.  Many  of  them 
went  through  this  training  system  in 
their  initial  transition,  and  again 
when  they  went  through  the  instructor 
course.  As  evidence  that  instructors 
are  using  their  own  judgement  as  to 
the  time  required  in  each  phase,  the 
standard  deviation  on  total  aircraft 
time  in  the  HH-52A  Transition  Course 
has  increased  from  2.9  hours  prior  to 
VCTS  to  7.2  hours  in  1976. 


New  Training  Program  used  with- 
out Simulator 


As  work  on  the  training  program 
and  material  progressed  ahead  of  the 
hardware  delivery,  it  was  possible  to 
experiment  with  some  of  these  con- 
cepts in  the  all-aircraft  HH-52A 
qualification  course.  Table  1 shows 
a comparison  of  times  in  the  Qualifi- 
cation course,  prior  to  implementation 
of  the  systems  approach,  with  times 
using  the  new  procedures,  but  without 
the  simulator.  Clearly,  some  of  the 
savings  attributed  to  the  new  train- 
ing program  are  achievable  without 
the  simulator.  No  degradation  of 
student  terminal  performance  was 
noted  by  the  admittedly  skeptical 
check  pilots,  or  subsequently  by  the 
units  to  which  they  were  assigned. 


SIMULATOR  FEATURES 

The  VCTS  simulator  complex  con- 
sists of  two  highly  sophisticated 
flight  simulators  - one  each  for  the 
HH-52A  and  the  HH-3F  helicopter  now 
in  service.  The  simulators  were 
built  by  Reflectone,  Incoporated 
using  a single  Datacraft  6024/3  com- 
puter with  a high-speed  disk  opera- 
ting system.  Each  cockpit  is  in- 
stalled on  a six  post  synergistic 
motion  system  providing  six  degrees 
of  freedom.  Training  time  lost  to 
maintenance  problems  remains  below 
one  percent. 

Advanced  training  capabilities 
include  performance  playback,  auto- 
mated demonstrations  of  selected 
maneuvers,  automated  performance 
scoring  and  in-cockpit  control  of  all 
training  and  environmental  condi- 
tions. The  instructor  rides  behind 
the  students  in  position  to  both 
monitor  their  performance  and  oper- 
ate tho  simulator  controls.  Two 
students  receive  training  as  a 
flight  crew,  with  one  acting  as  co- 
pilot. They  must  react  to  various 
malfunctions  as  a team  without  re- 
liance on  a safety  pilot. 

We  will  discuss  each  of  these 
features  as  to  their  actual  useful- 
ness . 


Performance  Playback 

The  performance  playback  fea- 
ture was  intended  to  be  used  in  de- 
briefing students  after  a maneuver 
or  malfunction.  Although  the  capa- 
bility exists  to  playback  from  one 
to  five  minutes,  rarely  is  anymore 
than  one  minute  used.  Instructors 
find  it  very  useful  especially  in 
high  workload  or  stressful  situa- 
tions to  play  back  the  last  minute 
of  the  event.  We  would  like  to  have 
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the  capability  to  replay  less  than  a 
minute  as  most  such  cases  are  of  very 
short  duration. 

Automated  Demonstration 

Manuevers  can  bo  stored  as  per- 
formed by  experts  for  demonstration. 
We  have  recorded  many  of  the  fliqht 
traininq  maneuvers,  but  find  little 
use  for  this  feature.  It  would  be 
of  more  value  in  primary  traininq 
than  at  the  advanced  level  undertaken 
here.  Instructors  feel  that  traininq 
IS  more  effective  if  the  student 
attemj)ts  the  maneuver  himself.  StiT-  ' 
dents  at  this  level  have  little 
trouble  visualizinq  a now  maneuver 
from  a verbal  description. 

Automated  Performance  Scorinq 

Subroutines  within  the  simula- 
tor proqram  allow  for  recordinq  of 
frequency  and  time  out  of  tolerance 
for  each  of  twelve  aircraft  para- 
meters when  either  the  "exercise" 
or  "checkride"  mode  is  selected.  The 
checkride  module  allows  data  to  be 
stored  permanently  for  statistical 
comparison.  This  data  bank  is  now 
larqe  onouqh  to  react  to  major 
chanqes  in  the  traininq  system. 

We  have  previously  reported  mild 
correlations  between  instructors 
subjective  qrades  and  the  computer 
scores  (Povcnmire  and  Ballantyne, 

1976)  and  a hiqhly  siqnificant  dif- 
ferentiation between  computer  scores 
of  students  and  those  of  instructors 
on  the  same  checkride  (Povenmire, 
1974).  It  is  obvious  to  us  at  this 
point  that  automated  scorinq  may  pro- 
vide useful  data  regardinq  one  phase 
of  pilot  performance  - namely,  ac- 
curacy of  tracking.  However,  it  is 
imixjssible  to  automatically  measure 
all  factors  that  indicate  pilot  per- 
formance. Many  judgemental  and  ra- 
tional processes  are  much  more  im- 
{jortant  than  how  well  he  maneuvers 
the  aircraft. 

Instructor  in  the  Cockpit 

Wr‘  have  realized  all  of  the 
anticipated  benefits  and  none  of  the 
cinticipated  disadvantages  of  having 
the  instructor  ride  along  in  the 
moving  cockpit.  It  was  predicted 
that  ho  might  have  serious  orienta- 
tion problems  due  to  the  washout 
features  of  the  motion  system  which 
presents  only  onset  cues  and  then  re- 
turns to  a near  level  attitude 


regardless  of  the  simulated  attitude 
However,  because  of  their  high  level 
of  flight  experience,  instructors 
automatically  look  to  the  cockpit 
instruments  and  justify  themselves 
to  simulated  pitch  and  bank  informa- 
tion rather  than  look  out  the  back 
window  to  find  real  attitude. 

With  all  simulator  controls  at 
the  instructor's  console  there  is  no 
need  to  have  an  additional  operator 
at  a remote  site,  thereby  reducing 
the  manpower  requirement.  When  both 
simulators  are  operating  there  are 
-two.Xt^ents  and  one  instructor  in 
each  cockpit — Thewi-J.S_a  1 so  a tech- 
nician on  call  in  case  of  a''sySf:em 
malfunction,  but  he  is  free  to  do 
other  projects. 

The  perfect  instructor,  accord- 
ing to  conversation  with  one  well- 
known  aviation  psychologist  would 
bo  both  mute  and  quadruplegic. 

(Hagin  1972)  We  come  close  to 
achieving  his  desired  conceptual 
result  with  healthy  instructors. 

The  instructor  does  not  interact 
with  the  students  in  the  context  of 
the  flight.  If  students  tend  to 
rely  on  him  he  overtly  discourages 
them.  If  asked  for  advice  he  says 
something  like,  "I  don't  know  sir 
I'm  just  a crewman."  He  is  out 
of  the  line  of  vision  for  the  stu- 
dents so  they  are  forced  to  interact 
as  a crow  and  troujjleslioot  oetween 
themselves.  The  instructor  will 
intervene  and  freeze  the  simulator 
when  the  students  either  use  an  in- 
efficient strategy  in  troubleshoot- 
ing or  become  disoriented  in  an  in- 
strument maneuver.  He  then  dis- 
cusses the  operation  while  the  cock- 
pit is  frozen,  Or  plays  back  their 
performeince  to  show  where  they  went 
wrong.  His  physical  presence  in  the 
cockpit  is  very  unobtrusive,  but 
very  essential  in  his  role  as  a per- 
formance evaluator  and  prescriber. 

ONCkJlWG  DKVKLUfMHNT 

After  throe  years  of  operation 
with  the  "new"  training  system 
shifts  of  personnel  in  leadership 
[xjsitions  resulted  in  a questioning 
analysis  of  the  program  as  it 
existed.  Subsequently,  two  major 
areas  wore  identified  for  critical 
analysis : 

1.  What  is  the  training  pro- 
gram accomplishing? 
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2.  Is  the  training  program  re- 
sponsive to  the  needs  of  operational 
Coast  Guard  units? 

Program  Evaluation 

For  the  first  three  years  train- 
ing program  accomplishment  was 
measured  in  three  separate  ways  - 
1)  Student  critiques;  2)  critiques 
completed  by  graduates'  Commanding 
Officers  and  3)  automated  performance 
scoring  on  an  instrument  checkride  in 
the  simulator.  The  two  critiques 
were  subjective  in  nature  while  the 
latter  gave  us  detailed  data  on  time 
in  seconds  and  frequency  that  the 
pilot  exceeded  preset  flight  parame- 
ter limits.  The  numerical  data 
clearly  demonstrated  that  the  per- 
formance of  Coast  Guard  pilots  on  the 
instrument  checkrides  was  improving 
year  by  year.  (Povenmire  and  Ballan- 
tyne,  1976) 

However,  since  the  checkrides 
wore  administered  only  at  the  end  of 
a course  it  was  unclear  as  to  whether 
the  improvement  was  in  the  pilot  or 
in  the  training  programs.  The  very 
real  possibility  of  an  undesirable 
tendency  for  the  instructors  to  teach 
the  checkride  existed.  The  data 
gathered  did  not  provide  any  confirm- 
able information  on  the  pilot  profi- 
ciency levels  or  tendencies  in  the 
service.  It  could  be  assumed  that 
the  lowering  of  checkride  scores 
showed  an  increase  in  scrvicewide 
pilot  proficiency,  but  other  expla- 
nations were  also  viable.  The  stu- 
dent and  Commanding  Officer  follow-up 
written  criticjues  continued  to  indi- 
cate basic  satisfaction  with  the 
level  of  training  received.  It  was 
apparent  that  we  were  doing  a reason- 
ably good  job  of  training  while  we 
had  the  pilot  captive  in  Mobile  but 
we  weren't  satisfied  that  we  were 
able  to  evaluate  the  overall  pilot 
training  program  of  the  Coast  Guard. 
Accordingly,  1 January  1976  the  Pro- 
ficiency Course  was  revised  so  that 
the  scored  instrument  checkride  was 
administered  as  the  first  event. 

This  slight  change  designed  spe- 
cifically to  provide  a measure  of 
Coast  Guard  wide  proficiency  levels 
also  provided  several  synergistic 
effects.  The  instructor  was  able  to 
identify  individual  pilot  weaknesses 
while  simultaneously  completing  the 
check  flight  requirements  for  annual 
instrument  rating  renewal  and  adding 


to  our  numerical  score  data  base. 

The  multiple  goal  accomplishment  at 
the  start  of  the  course  also  freed 
two  scheduled  training  [periods  for 
additional  emergency  procedures 
training  as  well  as  permitting  the 
students  time  to  practice  maneuvers 
that  they  personally  wished  to  work 
on.  The  numerical  data  accumulated 
to  date  indicates  that  the  overall 
level  of  pilot  proficiency  has  in 
fact  improved  over  the  years  the 
simulator  has  been  in  use  (Povenmire 
and  Ballantyne,  1976),  and  each 
training  program  was  raising  skill 
levels  during  the  course  of  the  pi- 
lot's stay  in  ^Vlbile.  Allowing  the 
pilots  time  to  practice  the  proce- 
dures they  wish  has  restored  their 
interest  in  the  course  and  elimina- 
ted the  anticipated  boredom. 

While  we  were  convinced  that  we 
were  improving  the  overall  skill 
levels  of  our  helicopter  pilots,  the 
major  goal  of  any  training  program 
is  providing  an  end  product  that  the 
user  desires.  Analysis  of  Transi- 
tion and  Qualification  student 
critiques  and  surveys  of  air  station 
Commanding  Officers  indicated  that 
graduates  of  our  Transition  and  Qual- 
ification courses  were  not  performing 
typical  copilot  duties  as  well  as 
desired.  Subsequent  review  of  our 
training  program  revealed  that  al- 
though the  students  receive  many 
hours  in  the  simulator  as  copilots, 
the  real  world  of  communications  and 
search  planning  are  not  well  simula- 
ted . 


Program  Changes 

A slight  shift  of  training  em- 
phasis in  the  simulator  and  addition 
of  a practice  search  mission  in  the 
aircraft  provided  a quantum  increase 
in  the  level  of  the  graduates  co- 
pilot skills  with  no  increase  in  the 
overall  course  length.  The  shift 
also  permitted  the  elimination  of  a 
two  week  navigation  review  course 
that  Coast  Guard  helicopter  pilots 
were  attending  at  NAS  Pensacola  as 
part  of  their  undergraduate  pilot 
training.  The  success  of  a slight 
change  in  course  content  in  meeting 
operat iona  1 re<iui n-runts  illustrates  tiie 
need  for  constant  review  of  training 
program  goals. 

We  also  formalized  a program  to 
monitor  reports  of  aircraft  equip- 
ment failures  submitted  from  the 
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field  units.  As  new  problems  would 
arise  wc  would  add  them  to  our  list 
of  simulated  malfunctions.  This  con- 
tinuous updatinq  of  the  t rain  in q to 
reflect  operatinq  experit'nce  has 
added  qreatly  to  student  pilot  enthu- 
siasm and  acceptance.  Our  experience 
has  definitely  shown  that  advanced 
fliqht  simulators  will  be  most  effec- 
tive if  the  end  product  of  the  train- 
inq  proqram  is  what  the  user  desires. 
Effort  expended  to  keep  simulator 
traininq  current  and  relevant  throuqh- 
out  the  life  of  the  traininq  proqram 
IS  as  important  as  effort  sf)ent  in 
th»'  oriqinal  desiqn  of  the  simulator. 

As  a result  of  the  new  [>olicy 
providinq  no  proficiency  flyinq  for 
pilots  assiqned  to  non-flyinq  billets, 
such  as  those  at  Coast  Guard  Head- 
quarters, a new  course  was  developed 
to  reijualify  those  people  when  they 
return  to  operational  flyinq.  This 
course  has  no  previous  counterpart 
and  has  not  been  included  in  the 
analysis  below. 

SAVINGS  IN  TIME 

As  we  have  shown  above,  some 
savinqs  attributed  to  advanced  train- 
inq concepts  used  without  the  simula- 
tor were  demonstrated  in  the  HH-52A 
Qualification  Course.  Additional 
savinqs  in  excess  of  30  hours  per 
student  were  realized  in  this  course 
when  the  entire  traininq  system  was 
implemented. 


In  the  1IH-52A  Transition  Course 
additional  traininq  requirements 
were  identified  which  required  addi- 
tional traininq  time.  Unfortunately, 
we  cannot  identify  the  exact  amount 
of  time  retjuired  for  each  student 
to  meet  these  additional  objectives; 
a conservative  quess  based  on  esti- 
mated fliqht  time  required  to  teach 
each  new  skill  as  part  of  another 
fliqht  rather  than  as  a separate 
fliqht  solely  for  that  purpose  miqht 
easily  account  for  between  five  and 
seven  hours.  On  the  other  hand, 
after  traininq  students  to  react 
properly  to  an  enqine  failure  in  the 
simulator  we  had  to  add  a maneuver 
to  the  simulator  traininq  proqram 
called  "practice  autorotations." 

This  was  to  (irecludo  a student  from 
shuttinq  down  the  enqine  in  a prac- 
tice situation  in  the  aircraft  and 
to  assure  that  the  enqine  was  bmuqht 
back  on  the  line  prior  to  the  criti- 
cal point.  Althouqh  the  total  cock- 
pit traininq  time  increased  over  the 
old  Transition  Course,  wo  have  re- 
duced the  calendar  time  requirement 
from  six  weeks  in  the  previous 
course  to  four  weeks.  The  HH-3F 
Transition  Course  has  actually  pro- 
duced an  averaqe  savinqs  in  excess 
of  seven  hours  over  the  old  course. 

Table  2 summarizes  these  savinqs 
for  the  three  courses  where  aircraft 
are  still  used.  In  addition  to 
these  savinqs,  one  HH-52A  aircraft 
was  removed  from  the  Aviation  Train- 
inq Center  allotment  when  the  VCTS 
was  implemented. 


TARLE  2.  TIME  .SAVING.S  PER  STUDENT  FOR  EACH  COURSE 


HH52A  HH52A  HH3F 

QUAI.  I FI  CAT  1 ON  CPU  RSF.  TRANSITION  COURSE  TRAllSTTION  COURSE 


FLIGHT  VCTS  WEEKS  HEIGHT  VCTS  WEEKS  FLIGHT  VCTS  WEEKS 


OLD  METHOD 

NEW  METHOD  NO  SIM. 

COMPLETE  NEW  SYSTEM 

TIME  SAVED 
STUDENTS  PER  YEAR 
TOTAI,  ANNUAL  SAVINGS 


77.3  9 

67.  8 7 

36.6  23.9  5 

40.7  4 

18 

732.6 


*35.8  6 34.9  6 

30.8  16.4  4 27.3  30.8  6 

5.0  2 7.6  0 

30 32 

150.0  243.2 


•Adjusted  time  reflects  approximately  five  hours  of  addi- 
tional traininq  which  was  not  included  in  previous  course 
but  is  presently  boinq  qiven. 
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Additional  savinqs  were  realized 
with  the  impleinontation  of  the  Pro- 
ficiency Course.  This  was  an  entire- 
ly new  course  intended  to  centralize 
and  intensify  the  instrument  and 
emerqoncy  procedures  traininq  that 
was  previously  beinq  done  at  each 
unit.  No  hard  figures  are  available 
to  indicate  how  much  traininq  was 
actually  replaced.  As  a matter  of 
policy  the  annual  traininq  require- 
ments for  each  aviator  was  reduced 
by  12  hours.  This  releases  approxi- 
mately 6,000  hours  a year  to  the 
Coast  Cuard  for  use  in  other  missions. 

SAVINGS  IN  DOLLARS 

In  determininq  the  cost  per 
hour  for  runninq  the  simulator,  all 
costs  associated  with  the  VCTS  were 
itemized  and  divided  by  the  actual 
number  of  traininq  hours  utilized. 
Costs  included  the  followinq:  field 
service  maintenance,  student  travel 
for  all  courses,  student  per  diem 
allowance,  salaries  of  five  civilians 
and  one  officer  added  when  VCTS  be- 
came operational,  and,  last  and 
least,  utilities.  These  costs  have 
increased  over  the  past  three  years 
along  with  everything  else.  However, 
utilization  has  increased  proportion- 
ately. Our  costs  per  student  hour 
have  remained  between  48  and  60  dol- 
lars. 

The  total  cost  for  the  first 
four  quarters  of  fiscal  1976  was 
$404,744.  During  the  same  period 
7,845.8  student  hours  of  traininq 
were  conducted  yielding  a cost  per 
student  hour  of  $51.59. 

Using  operating  costs  establish- 
ed for  federal  budget  determination, 
actual  aircraft  hours  saved  in  the 
Qualification  and  Transition  courses, 
and  the  aircraft  hours  released  from 
the  training  requirements  by  the 
Proficiency  to  other  Coast  Guard 
missions  we  have  been  able  to  demon- 
strate savings  in  excess  of  $2 
million  during  1976. 

SAVING  OF  LIVES 

On  several  occasions  our  simu- 
lators have  been  used  to  assist  in 
accident  investigation.  The  accident 
review  board  brought  both  pilots  to 
Mobile  after  ^ul  HH-3F  had  become  un- 
controllable. By  simulating  the  in- 
termittent failure  of  the  suspected 
components  the  pilots  "confirmed  that 
the  simulator  maneuvers  were  identi- 


cal to  the  aircraft  reactions  the 
night  of  the  accident."  (Tydings, 
1977)  Although  this  malfunction  had 
been  simulated  in  the  Proficiency 
Course,  it  had  not  been  shown  in  the 
intermittant  mode.  This  has  since 
been  added  to  our  list  of  required 
malfunctions  in  the  Proficiency 
Course. 

On  another  occasion,  an  acci- 
dent review  board  attributed  an 
HH-52A  pilot's  successful  autorota- 
tion in  an  extremely  critical  realm 
of  flight  to  "low  altitude  tech- 
niques demonstrated  and  practiced 
during  the  annual  traininq  received 
in  the  Variable  Coc)cpit  Traininq 
Simulator  (VCTS)  at  Mobile."  (USCG, 
1977)  . 

Although  documented  only  by  a 
phone  call,  we  have  saved  at  least 
one  aircraft.  The  pilot  of  ein  HH-3F 
called  the  Chief  of  the  Training 
Division  to  express  his  gratitude 
after  having  virtually  the  same 
serious  control  malfunction  which 
had  caused  the  crash  of  the  HH-3F 
discussed  above.  He  said,  in  effect, 
that  because  he  had  seen  it  in  the 
simulator  he  was  able  to  recognize 
it  immediately  and  switch  to  a re- 
dundent  system.  He  continued  to 
his  destination  through  the  clouds 
over  the  mountains  near  Kodialc, 
Alas)<a.  Acquisition  cost  for  one 
HH-3F  is  just  slightly  higher  than 
the  cost  of  the  entire  VCTS  simula- 
tor complex. 

BIBLIOGRAPHY 

Caro,  Paul  W. , Jr;  Hall,  Eugene  R. ; 

and  Brown,  CDR  Gilbert  E.,  Jr. 
"Design  and  procurement  bases 
for  Coast  Guard  aircraft  simu- 
lators." FT  Ruc)ce,:,  HumRRO 
Technical  Report  69-103,  De- 
cember 1969. 

Hagin,  William  V.  (during  attitude 
adjustment  hour  at  AFOSR/ONR 
program  review  at  University 
of  Illinois)  Montecello,  Illi- 
nois, 1972. 

Hall,  Eugene  R. , Caro,  Paul  W. , Jr. ; 
Jolly,  Oran  B.,  and  Brown,  CDR 
Gilbert  E.,  Jr.  "A  study  of 
U.S.  Coast  Guard  Aviation 
Traininq  Requirements."  Ft. 
Ruclcer,  HumRRO  Technical  Re- 
port 69-102,  December  1969. 


238 


Isley,  Robert  N.,  Corley,  Winon  E., 
and  Caro,  Paul  W. , Jr.:  "The 
development  of  U.S.  Coast 
Guard  Aviation  synthetic 
training  programs."  Ft.  Rucker 
HumRRO  Technical  report  FR-D6- 
74-4,  October  1974. 

Koonce,  Jefferson  M.  "Effects  of 

ground  based  aircraft  simula- 
tor motion  conditions  upon 
prediction  of  pilot  proficien- 
cy." Savoy,  IL:  Technical 
Report  ARL  74-4,  University 
of  Illinois  at  Urbana-Cham- 
paign.  Institute  of  Aviation, 
Aviation  Research  Laboratory, 
April  1974. 

Povenmire,  H.  Kingsley  and  Ballan- 
tyne,  LCDR  Kent  M.  "Automated 
scoring  of  instrument  flight 


checks."  Orlando;  Proceedings 
9th  NTEC/Industry  Conference 
Technical  Report  NAVTRAEQUIP- 
CEN  IH-267,  November  1976. 

Povenmire,  H.  Kingsley.  "Automated 
Performance  measurement  used 
in  quality  control  of  the  U.S. 
Coast  Guard  aviator  training 
System."  Oklahoma  City,  Pro- 
ceedings, 16th  Annual  Confe- 
rence of  the  Military  Testing 
Association,  243-256,  October 
1974. 

Tydings,  Harold.  THE  FORUM,  Society 
of  Air  Safety  Investigators 
Washington,  In  Press  1977. 

U.S.  Coast  Guard  Flight  Safety  Bul- 
letin, No.  47;  Washington, 

Jan  1977. 


ABOUT  THE  AUTHORS 


MR.  H.  KJHGSLEV  fWENMIRt  li  Ckiii  oi  the  TuUncng  Advliony  oi 

the  U.S.  Cooit  Guatul  Av-iation  T%cUning  CenteA.  He  ietivei  di  a tech- 
nical advl&o^  to  the  Chief  of  Aviation  Tna.inlng  on  ma.tte'U  affecting 
the  quality  of  tnatning.  He  iMi  fonmeAlu  a AeieoAch  oitoclate  and 
head  of  the  ftight  opetiaticm  gioup  at  the  Aviation  Reseanch  LaboAotoiy 
of  the  Imtctu-te  of  Av-uition,  Univeuity  oij  ltLlnol&.  PaIoa  to  joining 
the  leieoAch  itaff,  he  wcu  a flight  imViuctoi  and  iupenvlioA  of  the 
boAic  ftight  imtULCtion  gAoup  at  the  Uncvemlty  of  Ittlnoli.  He 
rectuved  hli  B.A.  degree  fAom  San  Diego  State  UniveAiity,  and  hli  U.S. 
degree  in  education  fxom  the  Unlvexiity  of  Ittxnoci. 


CVR  PAUL  D.  RUSSELL,  U.S.  CooAt  Guaid,  hoi  been  aligned  to  the  Cooit 
GuoAd  Aviation  Tuunlng  CenteA  in  Mobile,  Atahama  ilnce  1975  ieAvlng  oa 
Chief,  TAolnlng  Vlvl&lon.  DuAxng  pAeviouA  touAA  of  duty  he  uxu  a SeoAch 
and  Reicue  pilot  at  Cooit  GuoAd  Aaa  Statu om  in  PoAt  Angela,  Uodhlngton 
and  DetAolt,  Michigan.  He  hoA  oIao  AcAved  oa  a deck  offlceA  abooAd  the 
CcoAt  GuaAd  CutteA  KLAMATH  and  OA  a neinbeA  of  the  CoimunlcationA  Staff, 
U.S.  CooAt  Guaid  HeadquoAteAA . He  hotdA  a B.S.  degAee  fAom  the  CooAt 
GuaAd  Academy,  a B.S.  degAee  In  coimanicatlonA  eng<neeAlng  fAom  the 
Maval  PoAtgA^uate  School  and  an  M.E.A.  degAee  fAom  GeoAge  WoAhington 
UniveAAlty. 


CVR  DALE  R.  SCHMIDT , U.S.  CooAt  GuaAd,  lA  oAAlgned  oa  the  CooAt  GuaAd 
LiaiAon  to  the  Havy  Elight  TAolnlng  at  MAS  PenAOCota,  FtoAlda. 

He  AeAveA  oa  the  adveAOA  all  CooAt  GuaAd  Atudent  avlatoAA  and  thelA 
cuAAACulum.  He  tooA  foAmeAly  oAAigned  oa  the  Chief  of  the  HH-S2A  Taoca- 
<ng  Baanch  at  the  CooAt  CiuaAd  Aviation  TAolnlng  CenteA  in  Mobile, 
Alabama.  DuAtng  hcA  tenuAe  un  that  pcAltion,  CooAt  GuaAd  hellcopdeA 
tAxumng  {MA  Aevamped  and  the  pvteAent  pAogAom  utilizing  the  VaA-cable 
Cockpit  T'luUning  SyAtem  lma  initiated.  He  pAeviouAly  AeAved  oa  a 
SeaAch  and  ReACue  pulot  and  Flight  Safety  OfflceA  at  CooAt  GuaAd  AIa 
StahonA,  San  FAonclACO,  CalifoAnia;  Elizabe.th  C'tty,  MoAth  CoAolina; 
and  BeAmuda. 


239/240 


AN  APPROACH  FOR  IMPROVING  FLEKT  TRAINING 
THROUGH  TELECOMMUNICATIONS  SUPPORTED  SIMULATION 

WILLIAM  E.  W(X)DS  AND  KENNETH  A.  POLCYN 
PRC  Information  Sciences  Company 


SUMMARY 

Maintaining  fleet  readiness  in  light  of 
todav*s  resource  constraints  and  approaches 
to  operational  training  is  extremely  diffi- 
cult. Time  spent  at  sea  is  minimal,  indi- 
vidual ship  training  is  not  well  structured 
or  Integrated  and  Joint  ship  training  exer- 
cises are  few  relative  to  need.  Continuation 
ot  this  condition  may  not  be  necessary,  if 
the  r.S.  Naw  takes  advantage  of  telecommuni- 
cation and  computer  technologies.  With  these 
technologies  and  a common  centralized  data 
base  m*>st  U.S.  ship  crews  located  in  port 
could  train  as  If  at  sea.  Individuals  could 
be  trained  to  operate  their  respective  equip- 
ment; train  as  a team;  and  train  as  a weapon 
system.*  Further,  ships  in  port  throughout 
the  U.S.  could  be  aggregated  as  a task  force 
and  trained  as  if  in  a fleet  exercise.  In 
addition,  ships  at  sea  or  a combination  of 
ships  at  sea  or  in  port  could  be  pooled  to 
train  together.  Such  a system  has  the  poten- 
tial for  saving  millions  in  operating,  mainte- 
nance and  munitions  costs,  but  still  produce 
a fleet  trained  and  ready  to  neutralize  any 
attack  by  an  adversary. 

INTRODUCTION 

A constant  requirement  that  must  be  met 
by  the  U.S.  Navy  is  nuilntalning  a high-level 
ot  operational  readiness  so  that  all  possible 
eventuality  can  be  properly  addressed.  Meet- 
ing this  requirement  has  always  been  diffi- 
cult, but  today  the  problem  is  compounded  by 
limited  resources,  the  constant  Int  rt>duct  Ion 
ot  new  equipment  and  ships,  and  the  rapid 
modernization  and  challenge  of  the  Soviet 
Navy . 

l.ooking  at  the  essence  of  operational 
readiness,  the  backbone  has  been  the  training 
provided  on  and  by  the  Individual  ships. 

Each  Is  expected  to  follow  basic  training 
guidelines,  but  operationalize  as  they  see 
fit.  Each  individual  Is  expected  to  read)  a 
level  of  proficiency  relative  to  assigned 
tasks  and  to  operate  as  a member  of  a team. 
Each  team  is  trained  to  function  as  an  effi- 
cient and  effective  entity  interfacing  with 
other  teams,  aggregating  to  the  total  weapon 
system  — the  ship.  Unfortunately,  this 
training  autonomy  concept  does  not  always 

* 

"Weapon  system"  refers  to  a ship,  sub- 
marine or  aircraft  and  Is  Hyn<mymous  with 
"unit , " 


produce  the  desired  results;  consequently, 
there  is  a spectrum  of  readiness  within  a 
ship  and  among  the  ships  in  the  fleet. 

The  other  key  component  of  operational 
readiness  is  the  fleet  exercise.  Wliile  each 
ship  is  responsible  for  its  own  operational 
readiness,  they  must  eventually  come  together 
to  function  as  a member  of  a team.  Fleet 
exercises  are  the  basic  means  used  to  train 
and  test  the  capability  of  the  ships  to  per- 
form their  Individual  and  team  roles  in  vary- 
ing conflict  scenarios.  While  fleet  exercise 
training  is  desirable  because  it  is  as  close 
to  reality  that  is  possible,  few  are  being 
conducted  due  to  fuel  constraints  and  the 
operational  and  maintenance  costs. 

Because  of  the  above  problems,  the 
operational  readiness  of  the  U.S,  fleet  may 
not  be  what  It  should  be.  However,  it  may 
be  possible  to  rectify  this  situation  and 
save  a considerable  amount  of  money  over  the 
long  run,  if  the  U.S.  Navy  takes  advantage 
of  existing  technologies  to  Improve  opera- 
tional training. 

THE  TECHNOLOGIES 

Two  basic  technologies  which  may  permit 
the  U.S.  Navy  to  improve  their  op€»rational 
readiness  posture  are  telecommunications  and 
computer  technologies.  Advances  in  the  com- 
puter field  over  the  past  two  decades  are 
now  being  capitalized  on  to  provide  computer 
support  to  meet  almt)st  any  need.  Similarly, 
advances  In  telecommunications  now  permit 
reliable  communication  links  to  nearly  any 
location  on  t!ie  eartlu  By  combining  these 
teclinologies  it  becomes  possible  to  develop 
a large  network  of  interrelated  data  communi- 
cations and  data  processing  devices.  Conse- 
quently, Integrating  computers  with  today's 
telecommunication  can  provide  a flexible, 
accurate,  and  high-speed  transmission  along 
wltl)  a central  location  for  tlie  accumulat  ion, 
processing  and  the  ev.iluation  ol  data. 

These  technologies  are  not  torelgn  to 
the  U.S.  Navy.  Tliey  are  in  dally  use. 
l.lterally  hundreds  of  i-omputers  are  In  use 
in  tile  U.S.  Navy  to  include  "minis"  on  board 
siilps  and  "macros"  in  various  I'ONUS  command 
centers.  Every  conceivable  telecommunications 
means  Is  used  to  Include  conununicat ions  satel- 
lites, to  transmit  data  and  information. 
Tlierefore,  the  technologies  tliat  might  con- 
tribute to  ilie  Improvement  of  operational 
readiness  training  already  are  In  use.  Wiiat 
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is  nei'dfd  Is  <i  rt'i'rirntat  Ion  cif  tliinkiiiK 
towards  usln^  tlu'm  t»'r  operational  readlne.ss 

t raining- 

IHK  ^ll*^kAl  IDNAI.  KKADINKSS 
TRAIMSt;  (OKI)  CDNCKl’T 

Basii'allv,  the  heart  ot  the  OKI  system 
woulii  he  <i  tentr.illv  located  ionjpnt<*r  which 
wtnild  he  pro^jr.immed  to  simulate  a ranse  ot 
problems  that  would  he  Induced  into  the  In- 
strumentation of  wtMpon  systems  to  include 
surt.ice  and  subsurface  vessels  .ind  airborne 
vehicles.  The  system  would  he  flexible  enou^th 
to  stimul.ite  a sinj;le  piece  ot  equipment  on 
one  or  multiple  weapon  systems.  Further,  it 
wt>uld  he  .ible  to  aKRregate  equi[>ment  stimula- 
tit>n  to  effect  specialized  team  training. 
Moreover,  it  .ilso  would  he  able  to  address 
task  fone  type  training;,  stimulating  multiple 
pleies  of  equipment  in  a lar^e  number  of  wea- 
pon systems  according  to  a ran^e  of  scenarios. 
With  ttu*  aKkre^atin^t  feature  individual  equip- 
ment operators,  combat  teams,  a ship  or  a 
task  force  would  be  able  to  be  trained  and 
evaluated . 

Another  featiire  of  the  system  would  per- 
mit ships  that  are  in  port,  or  a combination 
of  port  and  sea  vessels  to  work  as  if  they 
were  at  sea  in  fleet  exercises.  The  system 
W4'uld  have  sufficient  coverage  to  include 
t-UNUS,  the  Atlantic  and  Pacific  Dcciins  and 
the  Mediterranean  Sea.  Consequently,  ships 
in  port  throughout  the  U.S.  could  participate 
in  ORT,  as  could  ships  at  sea  or  in  port 
throughout  the  world.  The  ORT  system  would 
be  able  to  tie  the  ships  together  in  any  com- 
bination from  any  place  in  the  world  and  treat 
them  as  if  they  were  working  together  at  one 
geographic  location.  Figure  1 delineates 
how  Weapon  systems  In  the  COffl'S  vicinity 
might  be  br<)ught  together  under  the  ORT  system. 

ORT  SYSTEM  COMPONENTS 

Tlte  ORT  system  would  have  three  basic 
components : 

1.  Shore  Training  Control  Center 

2.  Communications  Systemfs) 

j.  Unit  Training  Mode  Control  and 
Interface  System 

Shore  Trainings Cont rol  Center 

Tlje  Training  Control  Center  would  pro- 
vide for  the  initiation,  control  and  evalua- 
tion of  selected  training  exercises.  It 
would  require  a large  facility;  a staff  ot 
training  experts  and  support  personnel;  and 


the  hardw.ire  and  software  needed  to  provide 
operational  sienarios  to  units  for  training 
purposes.  n»e  tralfiing  f .u  lllly  concept 
would  be  very  similar  t(t  existing  facilities 
siu  h as  theiU’ft  Combat  Direction  Systi'ms 
Training  Center,  i-xcept  t lie  problems  would 
be  much  broader  in  scope.  For  example,  a 
single  facility  may  incorporate  the  features 
of  many  existing  training  systems  (l.e.. 

Device  2FH7,  Weapons  Systems  Trainer;  Dc'vice 
14A2,  Surface  Ship  ASW  F.arly  Attack  Wtapi)ns 
System  Trainer;  Tactical  Advanced  Combat 
Direction  and  Electronic  Warfare  System 
(TACT)EW)  etc.].  In  addition,  new  features 
may  be  provided  for  engineering  drills,  navi- 
gation exercises,  etc. 

While  the  discussion  thus  far  has  eluded 
to  a broad  range  of  training  th.it  could  be 
provided  to  the  fleet,  the  major  emphasis  In 
the  remainder  of  the  paper  will  be  placed  on 
training  in  ASW/AAW.  Ac'c  ord  ingl  v,  the  Train- 
ing Control  Center  would  provide  simulated 
training  problems  similar  to  those  currently 
operational  at  the  various  tacillties.*  The 
difference  lies  in  the  degree  of  sophist ica- 
ti(^n  in  simulating  the  "real  world"  and  the 
"place  training."  As  with  other  training 
exercises,  In  ASW  the  general  problem  parame- 
ters such  .IS  ocean  environment;  target  class, 
its  course,  speed,  depth,  etc.;  and  similar 
data  for  friendly  vehicles  (Ij\MI’S,  S-iAs, 
submarines  and  surface  vessels)  would  he 
initialed  and  controlled  at  the  Center.  How- 
ever, the  signal  inputs  for  Sonar,  Radar,  ECM, 
etc.  would  be  simulated  on  each  unit. 

The  advantage  of  this  concept  over  the 
current  system  is  chat,  while  the  training 
would  he  controlled  from  shore  the  actual 
training  would  be  conducted  at  the  unit 
level.  This  would  allow  several  units  to 
participate  in  coordinated  training  exercises, 
whether  in  port  or  at  sea.  Also,  each  unit's 
performance  can  he  evaluated  by  experts 
located  at  the  Center  as  well  as  by  personnel 
on  the  ship.  The  primary  purpose  of  the 
Training  Control  Center  would  he  to  provide 
the  fleet  with  operational  training  scenarios 
and  evaluate  their  readiness. 

* 

Tlie  range  of  training  provided  could  in- 
clude Naval  War  Caming  provided  at  the  Naval 
War  College  in  Newport,  Kliode  Island,  LAMl’S 
and  S- iA  pilot  training  (l.e..  Device  2F92, 

S- JA  Weapons  System  Trainer)  sonar  classifica- 
tion and  operator  training  (i.e.,  Device  14E19, 
Basic  Operator /Team  Trainer,  AN/SQS2b  CX 
Sonar)  and  anti-air  warfare  training  such  as 
provided  by  the  Tactical  Advanced  Combat  1)1- 
rt'Ction  and  Electronic  Warfare  System  (TACDEW) 
at  Dam  Neck,  Virginia  and  San  Diego,  Cali- 
fornia. 
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(iomnunlcat  ions  Sjrstem 

A variety  of  communication  modes  could 
be  used  to  dellvt'r  and  receive  problem  data 
from  Navv  vinlts.  Kor  example,  the  Naval  Tac- 
tical Oata  System  (NTDS)  Link  11  and  lA  fea- 
tures shoulil  be  considered  in  the  design  of 
tlu-  . i'mmtnii . at  ions  svsti*m  espeti.jlly  for 
stiff. Ire  warfare  training.  For  units  that  are 
on  shore  or  temporarily  in  port,  a direct 
line  link  may  serve  as  the  most  efficient 
channel  tor  Training  (Control  Center  to  unit 
ct'mmunlcat  ion.  Tills  ml^ht  Include  the  AAW 
Mobile  Training,  Van  or  MISTKK  concept.*  A 
variety  of  commun i cat i ons  approaches  should 
be  studied,  such  as  AirTODIN  and  FI  ee  tSat  Conrni . 
The  actual  coraniunicaLion  network  wt>uld  most 
likelv  ciMisist  ot  a combin.ition  of  systems 
with  tfie  determining  fattors  bein^  their 
avai 1 ah  1 1 1 1 V ; the  need  for  a real-time  system 
capability;  the  tvpes,  volume  and  rates  of 
dat.i  transiei  ; and  the  costs  associated  with 
the  operation  and/cr  design  of  a completely 
new  communications  system. 

Unit  Tralninj^  Mode  Interface  and  (lontrol 
Sj^^stem  (ITMICS) 

Tile  I'TMICS  would  be  the  final  component 
of  the  fleet  training;  system.  The  ITMICS 
wovild  be  physically  Installed  on  board  each 
appropriate  unit  to:  1)  provide  an  alter- 
nate mode  of  operation  (training  mode); 

2)  control,  process  and  distribute  problem 
data  received  from  shore  thus  furnishing  simu- 
lated inputs  to  tactical  subsystems  and  com- 
ponents on  board  the  unit;  and  3)  receive 
and  transmit  key  feedback  data  to  the  Training 
(Control  (‘enter  for  the  purposes  of  critiquing 
and  evaluating  the  training  problem.  Units 
receiving  the  ITMICS  would  be  provided  with  a 


* 

This  concept  de.ils  with  providing  ship- 
board training  and  system  testing  capabilities 
by  physically  interconnecting  a shore  based 
simulator  (Mobile  Van)  to  systems  on  board 
tfie  unit.  Recent  projects  sponsored  by  the 
Navy  in  tfiis  area  include  the  Digital  Accous- 
tlr  Sensor  Simulator  (DASS)  and  MISTKK.  Tlie 
Naval  Surface  Weapons  (’enter  Is  investigating 
DASS  .IS  a test  bed  for  ASW/AAW  aircraft 
training.  The  MISTKK  was  to  be  a surface 
shipboard  i ombat  system  plerside  trainer. 
lh»wever,  apparently  the  Navy  has  decided  to 
discontinue  the  project  primarily  from  cost 
rather  th.in  technological  problems.  In 
another  effort  the  Navy  is  studying  the 
feasibility  of  a Surface  Operatcir  Tactical 
Training  System  (SOTTS)  for  a prototype 
system  to  support  the  FF(i-7  Class  Frigate, 
complete  training  mode  capability  without 


sacrificing  the  tactical  mission  of  the  unit 
or  safety  of  the  crew.  For  example,  on  a 
destroyer  the  training  mode  would  provide  a 
capability  of  switching  radar,  sonar,  Inter- 
communicat ion  swl tchhoards , propulsion  sys- 
tems, etc.,  either  jointly  or  independently 
to  the  training  nK>de . This  would  allow  the 
injection  of  simulated  control  and  signal 
data  for  conducting  individual  and/or  team 
training.  Specific  functi()ns  which  could  be 
simulated  include  the  own  ships'  course  and 
speed;  radar,  KC.M  and  sonar  contracts;  and 
the  firing  and  tracking  of  delivered  weapons. 
Tlie  degree  of  simulation  and  the  physical 
design  of  the  UTMICS  wculd  depend  on  the  type 
of  unit,  the  fidelity  desired,  and  several 
other  factors  which  must  he  further  analyzed 
but  not  within  the  scope  of  this  paper. 

Figure  2 presents  a general  functional 
description  of  a ITMICS.  Again,  the  primary 
function  of  the  system  is  to  provide  a de- 
centralized equipment  and  subsystem  simula- 
tion capability  on  board  the  operating  unit 
but  under  the  control  of  a training  problem 
delivered  from  shore. 

A Standard  UTMICS  System 

It  would  be  advantageous  to  build 
a standardized  ITMK'S  configuration  that 
could  be  tallt>red  to  the  unique  interface 
requirements  of  each  type  of  unit.  With  a 
microprocessor,  such  a system  can  be  built. 

The  basic  elements  are  shown  In  Figure  3, 
which  are: 

1.  ijcternal  Interface  Processor 

2.  Main  Computer 

3.  Problem  Data  Storage  Unit 

4.  Demand  Driven  Multiple  Access 
Bus 

5.  Equipment  Interlace  Ports 

6.  Signal/Data  Converters 

The  problem  data  from  shore  would 
be  received,  controlled  and  transferred  to 
the  Demand  Driven  Multiple  Access  Bus  (DDMAB) 
via  the  External  Interface  Processor(s) . One 
or  several  processors  could  he  used  depending 
on  the  volume  of  data  to  be  transferred. 
Problem  data  would  be  read  into  and  stored  at 
the  Problem  Data  Storage  Unit.  Tlie  data  would 
tlien  be  further  processed  and  routed  to  the 
appropriate  destination  via  the  DDMAB  which 
would  be  controlled  by  the  main  computer. 

The  equipment  input  ports,  consisting  of  one 
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figure  2 Functional  Ovorviaw  of  Shipboard  UTMICS 


Figure  3.  Standard  UTMfCS  Configuration 


i>r  stvor.il  mi < roprorovssors , wduUl  ioiwert  llu* 
paranutor  dat.i  to  1 ronl  ond  svstom  si^’tial 
dll  I.  n\t*n  iii'pc*ndin>\  upon  llu‘  naturo  of  tfu* 
data,  it  would  be  formatted  .mcl  Injected  Into 
the  s vs  tern  via  a multiplexer  or  si^’n.il 
^entMator.  This  b.isie  system  ctnild  l>e  ex- 
panded simply  by  addinp,  ports  (mi<'ropr»ues- 
Si'rs)  and  interface  equi  pmen  t /sot  tware  . Keed- 
back  data  would  be  routed  bai k to  the  control 
center  usln>;  the  same  system  by  simply  moni- 
toring; system  control  set  tiny, s and  unit  com- 
munication circuits. 

APl’KitATUKS  HlK  PPRSIUNC  AN  OHT  SYSTKM 

There  .ire  several  approaches  which 
ml>;ht  be  ti>llowed  to  study,  design,  develop 
and  implement  a fleet  training,  system  con- 
cept . One  approach  would  be  to  look  at  a 
spei ifii  requirement  for  fleet  training  and 
not  attempt  to  solve  the  problems  of  the 
entire  fleet  at  one  time.  For  Instance, 
the  Navy  could  study,  design  and  demonstrate 
a fleet  training  capability  for  ASW  on  board 
a speiillc  t lass  of  destroyers.  If  this 
provi'd  successful,  the  concept  could  be  ex- 
panded to  include  AAW , engineering  and 
n.jvigation  training.  A second  approach  could 
be  to  investigate  the  requirements  for  a 
specific  type  of  training  but  which  may  in- 
clude several  types  of  Naval  units  (l.e., 

.iir  and  surface  ASW  fleet  training).  Then 
based  on  the  requirements  <ind  existing  fleet 
training  capab i 1 1 1 ies , a training  system  con- 
cept would  be  designed  and  tested  on  board 
selected  (pilot)  units. 

riie  above  approaches  would  apply  to  both 


current  and  future  fleet  training  require- 
mcMUs.  However,  a third  approach  would  be 
to  Investigate  tfie  training  requirements  for 
only  futun*  operating  units.  Tlu*  cr)ncepts 
would  l)e  designed  and  testcul  to  the  extent 
pr.ii  t icable  on  existing  vessels.  Then, 
future  procurement  efforts  would  liave 
d<*tailed  specifications  built  into  the  sys- 
tem design  requirements  of  all  applicable 
Nav.il  vessels. 

Keg.irdless  of  the  approach  followed, 
it  must  be  <*onsi.stent  with  tfie  Navy's  objec- 
tives for  providing  Improved  training  through 
simulation  at  an  affordable  cost.  In  addi- 
tion, the  concept  must  l)e  totally  supported 
by  the  fleet. 

CONCLUSION 

Because  of  the  limitation  on  resources 
and  time  at  sea,  there  is  a need  to  explore 
cost  effective  approaches  for  improving 
operational  readiness  training.  The  ORT 
system  is  only  one  of  several  alternatives 
that  can  be  pursued;  however.  It  has  con- 
sider/tble  merit  since  it  could  establisfi  a 
centralized  f rame-of-reference  to  train  and 
evaluate  individual  crew  members,  the  combat 
team  and  the  ship  as  a whole  in  the  perform- 
ance of  its  mission.  Further,  ships  on  all 
coasts  can  remain  in  port  and  still  train  as 
if  at  sea.  Finally,  the  system  can  be  im- 
plemented using  a number  of  approaches. 
Nevertheless,  a more  detailed  analysis  of 
the  concept  is  needed  before  a true  appraisal 
of  the  merit  can  be  determined. 
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TECHNIQUES  OF  QUANTITATIVE  PERFORMANCE 
MFJVSUREMENT  FOR  ASW  Tt^AM  TRAINERS 


BERNARD  W.  YAEGER  and  JAMES  D.  BELL 
Honeywell  Marine  Systems  Division 
California  Center 


ISTR(H)UCT1()N 

The  Need  for  Quantitative  Performance 
Measurement 

Rapidly  escalating  costs  In  operating 
weapon  systems,  coupled  with  energy  short- 
ages, has  drastically  affected  at-sea  combat 
team  readiness  training.  Slmulator/tralners 
are  increasingly  depended  upon  as  the  only 
economically  effective  alternative  to  provide 
this  training.  The  increasing  dependence  on 
simulators,  along  with  the  availability  of 
advanced  computer  technology,  has  led  to 
higher  demands  for  proof  of  training  effec- 
tiveness. Team  trainers,  in  particular,  due 
to  problem  complexity,  need  validation  of 
ef t ect iveness . This  need  for  proven  effec- 
tiveness has  placed  an  unparalled  demand  on 
tfu'  instructor  *s  ability  to  objectively  and 
comprehensively  evaluate  individual  subteam 
and  team  performance. 

Evaluation  of  complex  interrelated  and 
interdependent  per f orrminces  in  team  exercises 
is  exfemely  difficult  at  best.  This 
difficulty  has  resulted  In  elevated  interest 
in  the  application  of  But  the  use 

ol  CAI  techniques  requires  the  capability 
to  effectively  evaluate  the  current  perform- 
ance level  oi  trainees  as  well.  (Goldstein, 
1974).  This  evaluation  is  necessary  so  tfiat 
appropriate  courseware  logic  can  be  brought 
to  bear  as  the  driving  function  in  the 
control  of  exer<  ise  content,  complexity,  and 
diiticulty.  Therefore,  the  development  of 
objective  performance  measurement  techniques 
is  a prerequisite  to  t lie  use  oi  GA I as  well 
as  for  proof  oi  training  effectiveness. 

Honeywell  is  lurrently  involved  in  a 
sti'dy  oi  techniques  and  ctincepts  lliat  will 
prjvlde  detailed  team,  subteam,  and  individ- 
ual pertormance  measures  for  training 
vv  .nation.  The  purpose  oi  tiiis  paper  is  to 
Jescrlb**  the  requirements  lor  ASW  per forituince 
measurenent  and  a preliminary  < oncept  of  a 
mode’  which  meets  these  re<ju  1 rement  s . 

B.irkviround  - St  ite  of  ttie  Art  in  Per f oriiutnce 
Measurement 

It  was  noted  at  the  9th  NTK(!  Industry 
Conference,  1976  that: 


"After  more  than  30  years,  the  rating  scale 
remains  the  basic  evaluation  metlirid  for 
instructors"  (Shipley,  Hagin,  and  Cerlach, 

1976). 

It  was  furtlier  noted,  with  respect  to  ASW 
trainers  specifically,  that  ASW  exercise  eval- 
uation relies  primarily  on  subjective  instructor 
scoring  of  loosely  defined  areas  of  perform- 
ance. Figure  1 illustrates  this  scoring 
method  and  points  up  the  conclusion  that  ... 

"A  valid  scoring  system  requires  the  use  of 
objective  methods  ..."  (Copperman  and  Asa- 
Dorian,  1976).  This  example  draws  attention 
to  the  fact  that  current  evaluation:  (a)  is 
heavily  dependent  on  subjective  opinion,  (b) 
places  heavy  emphasis  on  commun lea t Ions  eval- 
uation, and  (c)  Is  not  efficient  in  identify- 
ing specific  areas  of  needed  improvement,  with 
examples  of  poor  performance.  Clearly,  the 
need  for  valid  and  reliable  quantitative 
performance  measurement  paradigms  is  nuindated 
by  the  need  for  proof  of  effectiveness  and 
applications  of  CAI, 

A previous  unpublished  study  found  that 
.'IS  many  as  60  to  70  measures  of  perfornuince 
were  available  and  could  be  used  for  ASW 
training.  However,  the  usefulness  of  measures 
simply  because  data  are  available  to  obtain 
them,  is  questionable.  Vruels  and  Goldstein 
(1976)  have  correctly  admonished  users  against 
the  unsystem.iL  Ic  application  of  perform.ince 
measures.  They  point  out  that  measures  must 
be  selected  wlilch:  (a)  tend  to  eliminate 
redundant  information,  (h)  are  sensitive  to 
skill  changes  which  occur  during  training, 
and,  (c)  liave  performance  predictive  qualities. 
They  presented  a method  for  selecting 
measures  based  on  multivariate  statistical 
mmiels,  wfiich  e\<iluate  the  total  set  of  can- 
d Ida t e measures . 

In  addition  to  tlie  problem  of  unsystem- 
atic application  ot  measures,  another  misstep 
that  must  be  avoided  is  the  .ippllcatlon  of 
<ipproaches  developetl  tor  otlier  purposes. 

M«>st  previously  developed  or  proposed  models 
simply  apply  sets  ot  measures.  Sophist Icated 
approacfies  to  a selection  ol  me.isures,  and 
statistical  reduction  of  data  have  been 
developed,  yi*t  the  evaluation  .ipproach  itself 
remains  hasli  .il  ly  unstructured.  (Keferi'nces 
a,  c,  d,  and  f),  I'vio  major  obstacles  are 
manitesl  in  these  .ipprv>ai  hes . First,  the 
measures  that  are  available  tend  to  be  directed 
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rOM  M A N I )/  F V MJ’AIXJR 


COMMAND  FVAT.I  ATOR  CKNFRAI. 


W:i.s  SAT  I'iimmrujdor  aware  of  tactical  empiovmeri!  of  all  units 
vmder  hia  command'^ 

Was  a low  nf)iso  level  malntaincsl  m (*K’? 

Was  < lassifiratn-n  a conlinmsis  pro;  ess  bv  SAC  (■<»rn'’ian<k'r 

W'ere  four  weaf)on  attacks  succ.*ssful?  (An  ur^jen  .itUck  does  nf>l 
need  to  be  a hit  in  order  to  tx*  considered  successful. ) 


APrilOACll  I’HASK 


Was  Datum  proju  rly  dissc'tMniiled  to  all  units'* 

U’as  S/\l.'  profxTh  ff)rmed  up,  and  was  spacing  Correct,  cons>d<‘rin#; 
predjcttxl  s«»nar  ranRo'^ 

Was  SAC  s«‘ari*h  front  pro^M  rlv  ro-ortlered  and  v^as  approach  to 
Datum  pro|M*r  for  Uictical  situation? 

Were  Cone  of  ('ourses,  InU^n  ept  Course,  and  time  to  enter  TDA 
compared  and  concurred  with  Assist  Ship? 

W'ere  appropriate  countermeasures  executed  dunnR  Apprt«rh 
Phase  ? 

Were  Plans  lU*d  and  Black  and  Weapons  Policy  passed  to  Assist 
Ship? 

Was  controlling  station  prope  rly  kept  informed'* 

Were  air<*raft  plots  evalualeil  to  determine  tar^rl  course  and  spee<!? 

Was  time  U>  enter  IliA  u|Klat<‘d  with  latest  contaet  information  and 
new  lnl<*rcepl  Course  executed  accordinRly '* 

SWAP  SITHKl’  rtxpiesU-d  and  olit.iined  pnoi  p.  ution  of  SWAP. 

SWAP  SITKKP  dissemin:ited  to  commaml,  with  Slate,  Weai>«)n.s, 
Contact  status,  and  Datum  information  im  ludeil. 

SWAP  execute*!  in  a timelv  r’ar.ner. 

SAC  advised  when  SAC  is  ass  niied. 

ZlR-ZaR  Plan  exe  mted  prior  to  entering  7T>A. 

Appr'»t»riate  Material  Coiiotermeasures  preptied  or  exccuU*<l. 


Figure  1.  ASW  Kscort  Qual it  teat  Ion  Program  Kvuluation  Form 
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tiiw.irils  mtMstiri*  ot  i lul  i v i (Ui/i  1 skills.  Tlu* 
intvrprrtat  i<>n  t't  surh  mtMSurfs  with  respect 
to  t.isks  whii  h are  int  erre  lat  i‘<l  betw«»en  groups 
ot  itid  i V itlua  1 s is  elusive.  Secondly,  previous 
mod^'ls  tenil  to  .issume  the  training  exerciso  it» 
question  is  a ci>m|>lex  inH'^rated  ,ind  c«)ntin- 
uous  task.  Ttierefore,  measures  are  sc'Iected 
(usually  tor  post  txerclse  criti(jue)  wliich 
.It  tempt  to  summarize  aspei  t s t>t  performance 
throu>tlunit  th»-  entirety  oi  the  exi*rcise.  Ttie 
d.jn>;er  ot  such  .in  appri>a(  h lias  been  incisively 
de.s»riht*d  (Vruels  .ind  (rt>ldstein,  lQ7f»). 

”Me.»sures  which  are  not  usetul  tor  one 
condition,  hut  which  are  'carried  along' 
to  cover  a seciMid  l ondilion,  might  degrade 
the  power  ot  th*-  Set  todestrihe  the  first 
contlition.  Tims,  one  must  he  cautious 
in  the  .ippllcation  of  universal  measure 
sets  l«i  iu>ver  a v.iriety  of  task  situ- 
at  ituis . " 

Ihe  unsatisfactory  applications  of  pre- 
vious approaches  illustrate  that  performance 
measurement  methodology  fi>r  team  training 
needs  more  development.  For  this  reason,  we 
must  tirst  start  bv  addressing  the  require- 
ments f(>r  ASW  te<im  training. 


APl'KoACh 

Kequ  i remen  I s tor  ASW  Per  f ornuuu’e  Measurement 

ASW  team  training  exercises  such  as  tliose 
using  the  l^Al?  trainer,  tr.iin  sever.il  suhteams, 
in<  lu<iing  ('!(.,  I'h  Plot,  Sonar  .uui  Air  Ixuilrol. 
Iraininw.  i?,  diristod  at  the  development  of 
V .>ord  in.Jt  ion  ot  operation.il  procedtires,  anil 
commun  ic.it  ions  both  witliln  and  hi-twi-en  suh- 
Itsims.  lai  t Ics  is  l.aught  at  .1  Learn  level. 
Dittennt  exi  r»  ises  address  divergent  train- 
ing objeitivi'S,  su(  h .IS  ASH(K-  Weaptm  Delivery, 
ASW  Kscort  Missions,  .ind  ASW  flelo  Vectored 
Atl.i'k  exercises.  Iliese  exercises.  In  turn, 
r..iy  he  divided  into  disirete  phast  s such  as: 
Appro. ich,  Se.jrch,  Iraiking,  Attack,  i‘ost 
Atf.ick,  .ind  host  Contact  . Ph.ises  comfrusice 
and  are  terminated  hv  key  events,  sucli  .is 
cont.aet,  Wf.ipon  .issJgnment,  ete.,  which  define 
the  conditions  within  a phase.  I.isk  require- 
ments c.in  he  significantly  ditlerent  in 
various  ph.ises.  Significant  variables  effect- 
ing performance,  in  ASW  training,  inelude 
environmental  conditions,  complexity  of  target 
submarine  m.ineuvers,  and  (simulated)  malfunc- 
tions. The  team  must  he  exposed  to  and  trained 
to  handle  these  v.irylng  eonditlons. 

The  complexity  of  the  ASW  combat  readi- 
ness precludes  a more  comprehensive  discussion 
of  the  training  problem  within  the  scope  of 
this  paper.  However,  the  requirements  for 
perfc»rmanre  measurement  can  bo  briefly  sum- 
marized as  follows: 


1.  The  set,  or  composite  of  quantitative 
perform.ince  measures  must  be*  compre- 
hensive, and  based  on  observed  or 
computer  recorded  data  (qualitative 
data  should  be  avoided). 

2.  The  set  of  measures  must  provide  v.iJ  Id 
contributions  to  team  perfornwince 
evaluation  (sensitive  to  performance 
clitinge ) . 

3.  The  set  must  define  performance  in  a 
manner  such  that  specific  performance 
needing  improvement  can  he  Identified 
(avoid  loosely  defined  parameters). 

A.  The  set  must  be  readily  modifiable 
to  reflect  the  training  objectives 
of  different  types  of  exercises. 

5.  Ihe  set  must  Include  performance 
measures  from  all  phases  ot  the 
exerc  ise. 

6.  The  set  must  include  measures  of  team, 
subteam,  and  individual  performance. 

7.  The  set  must  be  adaptable  to  differ- 
ent levels  of  complexity  in  several 
exercise  variables. 

H.  The  set  of  measures  must  be  subject 
to  weighting  which  reflects  the 
user's  desired  emphasis  of  the 
various  f.ictors  of  perforrruince . 

Frel  iminary  (Concept  for  an  ASW  Team  Perform- 
iiiu  e Measurement  Mode  1 

Attempting  to  devise  .in  appro.ich  tor  a 
Derformance  MiMsurement  Model  that  meets  the 
reipi i rement s previously  discussed  above,  has 
led  Honeywell  to  adopt  a t hrt e-d imens iona I 
matrix  model  .is  illustrated  in  Figure  2.  The 
first  dimension  represents  individuals,  which 
in  turn,  are  grouped  into  suhteam  blocks.  The 
second  dimension  represents  categories  of 
me.isurement  , whic  h iri<  luJes:  (a)  procetiures, 
(h)  conaimn  icat  ions  , (c)  ac  cur. icy,  (d)  tactics 
and,  (e)  time.  Ihe  results  ot  our  .inalysis 
Indicates  that  mi'st  me.iningtul  measures  ot  ASW 
team  training  fail  within  one  ot  these  cate- 
gories. The  third  dimension  represents  phases 
of  the  training  exercises.  Any  specitii' 
exercise  may  consist  of  one  or  more  ph.isi-s 
ilependlng  upon  training  objectives.  Thus, 
performance  measures  are  referenced  ti>  specific 
suhteam/phase/category  problem  components  which 
are  designated  as  cells. 

Each  cell  limits  tfie  area  ol  measurement 
to  a specific  operatlon.il  definition.  Ihere- 
fore,  very  specific  quantitative  perfornuince 
me.isures  can  he  developed  with  iiighly  del  inl- 
tive  meaning  and  iiiterpret.it  ion . Each 
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moasuri*  a(iilress€*s  a specific  per  t t^rmarn'i*  in  a 
spocitic  ph.iso  or  task  i(nnlltl<in.  Wliilo  It 
Is  not  nocessary  or  ovon  Intondoci  that  a 
quant  1 1 .It  i ve  moasuro  can  bo  dovolopod  for 
4*vorv  ooH.  p.i  rt  i t i on  I n}^  iiito  colls  enables 
manv  miMSuros  to  bo  used  which  woulti  bo  In- 
apprt'pr  1 .It o it  t hoy  woro  interpreted  as 
niiMSuros  ot  total  problem,  total  phase,  or 
tol.il  subtoam  per f ornunico . 

('♦'mb in  in^  I'c  r I ormanco  Measures 

Individual  perform. UK  o measures  can  bo 
used  tor  feedb.ick  to  the  tr.jinees,  i)ut  they 
.innot  be  dirovtlv  ct'mblned  represent 
pertermaiKe  at  a broader  level  of  perform- 
anc»*  evaluation.  Clven  tlie  quantitative 
measures  f*>r  »11  appr<'*pr  i<ite  cells,  composites 
ot  these  measures  must  be  summ.ited  to  provide 
.»n  evaluati-’n  bv  categories,  pleases,  .nui 
personnel  levels.  This  summ.it  i(Ki  is  possible 
when  Individual  measures  are  t r.msf  i>rmed  or 
••onverted  into  st.ind.ird  st.ile  scores  ("/*' 
Scores,  for  ex.imple).  The  total  of  all  in- 
dividual  I ell  scores  represents  the  total 
team  score.  Although  the  total  score  summa- 
rises the  total  team  per f oriminc e level,  it  is 
rat  sufficiently  descriptive. 

The  set  of  individti.il  cells  m.iy  be  com- 
bined into  ihri'e  m.ijor  composite'  groups. 

Tlu-se  iomposites  are: 

1.  Suit  earn  Compt'siti*  Stores 

2.  Kxer.  i:,c  Phase  (lomposite  Scores 

i.  Measur»s!ienl  C.itep,ory  Composite  Scores 

Figure  ^ shows  an  example  ot  the  com- 
positt*  of  '.ells  tor  the  sonar  subteara  score. 
This  ore  represents  subte.im  pt  rtorrnance 
.ler^'ss  all  pliases  and  -alegorles  ot  me.isure- 
ment  . Idle  total  comt'osite  ♦.in  be  divided  into 
S'lbsets  by  summing  a(  ross  rows  or  .o  ross 
columns.  Sii>res  s«i:nmed  across  rows  provide 
subt'-ar  scores  by  measurement  i.ilegory,  i.e., 
Sonat  Procedures  Score,  tOr  .ill  ph.ises. 

:icor«-'.  “>*imnu'd  a.  ross  « c'Iumns  geiu'i.ite  subteam 
scores  in  .ill  cilegorii'S,  tor  a specific 
pfias»  , i.e..  Son. if  Alt.uk  IMiasc*  S<*or»'. 

An  exrimplo  ot  <«  (lompos  i t <■  sc  i're  l)V  l-.xc*i  - 
■ isi-  Phase  is  llluslr.ited  in  Figure  . Tlie 
I’fi.isc*  <iomposile  Scores  repr«*s<*nlH  tin*  lot  il 
tc'.ira  Si-. -re  for  t fie  liesiguated  ph.ise  1. iking 
into  .ic.  ount  .ill  SI  ble.ims  and  i'ateg*)rles  ot 
nu-asurenietit  . Suf'sets  ot  scores  summed  in  rows 
results  in  .1  le.im  store  ti)r  each  (ateporv  witfi 
respect  to  the  pfi.ise  repr<-Henled  by  tfu*  com- 
posite*. Summ.ilion  ot  tlie  column  sul'set  td 
scores  gives  sufiti-am  Hior»‘S  for  .ill  c.at  egc»r  ies 
witfi  in  rfi.it  phase*. 

An  ex.imple  tif  t fu-  Me-asun'ment  (lategory 
Composite  Score  is  ileplcted  in  figure  *) . Ifie 


composite  Is  the  team  score  for  all  phases  In 
the  procedure  category  of  measurement.  Kxam- 
Ination  will  show  that  subsets  of  scores  within 
this  composite  yield  redundant  information 
obtaine*d  by  the  subsets  of  scores  previously 
desc  r 1 bed . 

The  capability  of  tlie  model  to  provide  a 
set  of  scores  by  column  and  row,  a composite 
score  by  subteam,  category  or  pli.ise  and  a total 
score  for  all  cells  offers  a unique  opportunity 
to  evaluate  team  perf orm.ince  and  select  new 
problems.  For  example,  if  a te.im  is  we.ik  in 
communication,  during  the  lost  contact  and 
attack  phase,  a problem  c.in  be  selected  (or 
modified)  to  provide  extra  practice  In  these 
phases  with  team  Ciincent  rat  ion  in  improving 
communication.  Similarly,  if  tlie  team  is  weak 
in  tactical  coordinat  ion  .i  problem  with  this 
empliasis  can  be  selec  ted.  In  gener.il,  the 
proposed  metfu'dologic.al  approach  can  provide 
..a  average  comp.irat  ive  score  and  part  scores 
showing  the  particular  strengtfi  and  weaknesses 
of  each  team. 


Measurem_^n_t  Techn i(|iu*s 

Tfie  measurement  of  performance  for  each 
cell  described  above  ciepends  upon  the  .ibility 
to  detect  the  performance  involved.  (’•bviously 
the  computer  c.in  measure  all  p«*rtormance  re- 
sults which  interact  with  the  program,  but 
manv  other  very  desirable  and  necessary  per- 
form.ince  me.isures  are  not  av.iilable  to  tlie 
computer.  Ihese  team  performances  must  be 
observed  .ind  me.isured  in  some  way  f>y  .in  in- 
structor or  prof'lem  monitor.  Tfie  following 
aiscussion  idi-ntities  the  computer  versus 
monitor  requirement  lor  c.-acfi  performance 
ca  i c'gory . 

• Performance'  Mtiniie'ring 

^hie  ol  tfie  prinurv  objectives  ot  ASW 
team  training  is  teailiiag  tr.iinees  to 
follow  and  ['lactii-e  tlie  t'Stabl  I sfled 
procedures  tor  their  t.isks.  The 
following  of  est.iblished  proci-dures 
or  doctrine  lu'lps  to  assure  effective 
t earn  per  f ormanc»  . Proceilure  t o 1 low- 
ing, .IS  ccinsidored  fieie,  consists  ot 
♦•onsole  .u)d  I’quipnienl  c»pei  .it  ions , 
manual  o|)e r.i t i ons  involved  in  plotting, 
'.t.itus  1)0. ird  updating  and  log  ki-eping. 
Procedures  in  conducting  communica- 
tions .ire  covered  in  the  separate 
communlcat ions  category. 

For  tile  purposes  ol  I'va  I nation  and 
training,  all  inc'orreil  procedures 
sfiould  he  di’tec-ted  so  eacli  oc'currence 
♦'an  he  recordeci  .ind  weigliled  tor 
cr  1 1 icM  1 1 1 y . Feedh.u  k to  the  te.ini  is 
necess.iry  lor  coi  reel  ion. 


Hu*  dftoctlon  ol  procoilur.il  orri>rs  by  t lu* 
computer  can  be  accomp I I slioJ  If  two 
roqu  i remiTit  s .ire  mi*t  . These  .ir<*: 

1,  riu’  switch  position  t>r  etjuipnuuit 
oporat  ion  must  bi*  sonsetl  bv  the 
ci'raput  or » 

2.  A sl.iiul.irti  problem,  or  portion  of  a 
sfarul.ird  problem,  must  be  used  so  the 
dtu  trine  procedure  can  be  proKr.imined 
i(’r  I i>mp.ir  i son , 

In  ilvn.imic  exercises  where  tlie  team  and 
computer  interact  and  react,  the  number 
of  doctrine  switch  settings  which  can  be 
predicted  Is  severlv  limited.  The 
number  of  possible  choices  available  to 
the  operator  must  be  limited  by  slruc- 
Curing  the  problem. 

In  these  dynamic  situations,  an  observt*r 
can  be  more  effective.  A well  tr. lined  observer 
can  monitor  the  operator's  actions  and  record 
t hi-  error,  time  of  occurrence  and  criticality. 
These  equipment  operator  procedural  errors  can 
be  combined  with  the  other  observer  detected 
errors  siuh  as  manual  errors  which  are  not 
available  to  the  computer,  l.e.,  ovmual  plot 
entries.  All  such  errors  should  be  detected 
and  im  luded  in  the  team  performance  evaluation. 
It  should  be  noted  here  that  the  number  of 
procedural  errors  will  be  more  useful  as  a 
score  th.in  the  number  of  correct  actions.  This 
count  will  then  incliKle  both  errors  of  omis- 
sion and  commission  and  will  be  much  more 
useful  in  calling  specific  errors  to  the 
attention  of  the  team  for  correction. 

The  need  to  weight  errors  In  terms  of  sig- 
nificance is  also  a possibility.  Weight  inn  of 
scores  in  terms  of  criticality,  or  effect  on 
mission  success  could  affect  the  team  score 
but  would  be  of  less  Importance  in  feedback  to 
the  team  for  correction. 

When  the  procedural  error  score  Is  within 
a satisfactory  tolerance,  tralninn  on  proce- 
dure following  can  be  considered  as  complete. 

• Accuracy  Measures 

Mtisf  measures  of  operator  and  team  per- 
formance accuracy  can  he  obtained  by 
the  «-omputer.  In  fact,  the  computer 
Is  ideal  for  recording  and  making 
operator  accuracy  measurements.  ITiese 
nH*asurem€*nt s can  include  a great  number 
ot  positioning,  tracking  and  switch 
setting  actions  which  are  a measure  of 
operator  skill.  Such  measuremimt s can 
be  made  perlodltally  at  one  second,  ten 
seconds  or  one  minute  intervals  for 
continuous  operations  or  when  specific 
events  occur.  Wlien  continuous  oper- 


. It  ions  are  Involved,  a beginning  and  an 
ending  event  is  required  to  prevent 
m.iklng  measurements  at  inappropriate 
(imvs.  For  ex.jmpJe,  lor  sonar  cursor 
positioning,  accuracy  should  not  be 
recortled  before  contact  nor  after  time 
o t fire. 

In  addition  t tbi^  computer  recorded 
.11  4 ura*  y measurements,  some  accuracy 
measurement  may  need  to  be  made  by  the 
instructor  or  observer.  Manual  plot- 
ting accuracy  is  one  such  example  which 
is  norrmilly  not  available  to  the  com- 
puter for  me.'isurement . 

Ihe  evaluation  of  accuracy  measurements 
can  also  be  made  by  the  computer.  The 
accuracy  of  a specific  team  can  be 
t ompared  by  the  computer  with  the 
accuracy  of  other  teams,  with  a fleet 
criterion  or  with  allowable  tolerance 
b.inds.  These  comparisons  are  necessary 
for  an  evaluation  of  "liow  good”  or  "how 
bad.”  Tills  inforiTuit  ion,  as  well  as  t lie 
raw  .iccuracy  data,  should  be  supplied 
to  the  team  as  feedback  an<l  reinforce- 
ment . The  actual  measurement  and  when 
it  occurred,  can  help  the  operator 
to  improve  i)er t ormanco  . Graphic  data 
can  shi’w  trends,  time  of  errors,  vari- 
ability of  performance  and  bias.  This 
specific  data  can  be  most  beneficial 
for  operator  and  team  training  and 
Improvement . 

• Communication  Measures 

The  current  practice  for  team  evalua- 
tion as  sliown  by  the  ASW  Kscort  i^uali- 
flcation  Report,  Figure  1,  Is  heavily 
weighted  with  communications  between 
various  team  members.  Over  50%  of  the 
specific  evaluation  entries  relate  to 
oral  reports  or  Involve  communicat ion 
between  team  members. 

Unfortunately,  computer  Interpretat ion 
of  the  spoken  word  is  not  yet  feasible 
so  observers  must  be  used  to  sense  and 
evaluate  the  communication  between 
various  members  ol  the  team. 

As  in  the  cast*  of  procedure  following, 
tlie  detection  and  scoring  of  communi- 
cation error.s  4>nly  Is  the  preferred 
approach.  This  appro. ich  assumes  that 
mo.si  communicat  Ion  will  be  appropriate, 
correct  and  will  ot  ur  at  the  proper 
time.  The  observers  can  then  concen- 
trate on  obvious  errors  which  require 
correction.  These  errors  can  be  clas- 
sified under  the  following  types  and 
examples  tor  le.ira  evaluation  and 
scor 1 ng : 
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1.  Krrors  In  transmitted  <lata,  l.e., 
true  bearin>^  reported  when  rela- 
tive bearing  Is  correct. 

2.  Misse<l  inform.it  ion  report,  l.e., 
target  doppler  not  reported. 

lmpro|>er  ( «>mmun  Icat  ion  procedure, 
i.e.,  non-doctrine  clioice  of  wor<is 
or  secpu'nce  ol  liata. 

U . Unnecessary  commun icat ion , i.e., 
irrelevant  commeiits  t)r  criticism 
during  the  pr<iblem. 

It  the  oi>server  ran  record  .ind  cotint  these 
>1  errors,  a high  count  would  obviously 
ite  the  neeil  tor  more  training.  Similarly, 
count  would  ra-tlect  t lie  performam  e ot  a 
; t a i ned  1 1 am . 

» Timiug  Measures 

ihe  time  required  by  a team  to  accom- 
plish a specific  result  is  a slgnlilcant 
indlialion  of  team  per  f ormatu  f . A 
minimum  time  score  usually  indicates 
efticiency,  effectiveness  and  .ibsenci- 
tit  errors.  Team  scores  can  be  a very 
useful  summary  inclicator  of  the  skill 
li'Vi'  I ol  te.ims. 

Timing  mea.svires  recpiire  a beginning 
event  i»t  signal  .irul  a terininatlng 
4'Vent  or  ‘.ign.il.  Du-se  signals  may  hi- 
ileteife.l  directly  bv  the  i'omputer  or 
may  require  a cue  from  the  monitor. 

Ihe  (omputer  records  t lie  time  ol  t he 
event  and  reconis  the  ela[)sed  lime  as 
the  measure.  Ihis  I ime  piT  iod  i .in 
then  be  comparetl  ior  team.  Individual, 
and  problems. 

!»•  be  meaning!  ul  the  team  scores  should 

■ ailv  be  usetl  under  st  itulard  problem 

. end  i i iofis  . When  the  initi.jl  problem 

■ •uiditions  are  ldenti(<ii,  .ind  carefully 
iiurolled,  the  variation  in  time  be- 
tween Individuals  or  teams  is  due  prl- 
marilv  to  t lu-  skill  level.  It  is 

r. sinned  that  tile  shorter  the  time 
requiretl  ti)  rea<  h the  ohjeitivi',  the 
higher  is  i lu-  skill  U-vel  ol  the  te.im. 

9 I at  tits  Mi  asur  es 

Ihe  mi-.isuri-nient  ot  the  l.utlt.il  movi*s 
rn.itie  hv  a it-am  in  a givi-n  problem  sil- 
<1. it  ion  ind  t h*-  stihseqnent  I'valinition  ot 
these  mtives  in  terms  of  tactical  effec- 
t Iveness,  adh«*reni.e  to  doctrine  and 
training,  is  in  a different  dimension 


than  tiie  previous  measures.  It  Is 
obvious  that  tactics  Is  a significant 
factor  in  the  overall  perf ortruince  of  the 
team  and  In  the  evaluation  of  the  team. 
However,  the  ratlrmale  and  techniques 
which  may  he  used  for  tactics  measure- 
ment re(julres  a more  sophisticated 
apprttach  than  described  above. 

Our  current  effort,  in  conjunct  ii>n  with 
fX'cisIon  Sciences,  Inc.,  of  San  Dlegr),  (Calif- 
ornia, is  the  use  of  a (Came  Theory  Appr  -e  h 
wh  i ch  ev.i  1 ua  I f*s  adver  sa  ry  t ac  1 1 ca  1 m.in<*u  ver  s . 

This  effort  is  in  the  early  stage  <)t  develop 
ment  and  results  are  not  available.  However, 

It  is  anticipated  that  numerical  values  will 
become  available.  These  numerical  v.ilues  will 
be  converted  into  scores  and  combined  with  l be 
team  scores  described  .ibove  for  a tot.il  team 
eva  1 u.it  ion  . 

• Kesu Its  to  Date 

The  ASW  Tacti<-s  learn  Trainers,  locnte(i 
at  Fleet  ASW  School  at  San  Diego,  Ca 1 i - 
forni.i,  have  1-eor.  rr  .'T'LTjne  i to  ir  vi  ie 
computer  [jrintouts  oi  problem  d.it.i. 

The  initi.il  .ipproa<  h h.is  been  to  print 
out  all  dat.i  in  r lu-  dat.i  base  once  each 
second  tor  analysis.  The  d.it.i  tor 
several  pilot  exercises  were  collected 
ami  .analyzed  in  detail. 

Data  lor  tactics  evaluation  and  commu- 
nication was  not  collected.  Procedure 
following  and  timing  data  were  available 
but  meaningful  evaluations  could  not  be 
made.  Arrurar-v  measurements,  however, 
proved  to  be  very  interesting.  Figure 
h shows  the  sonar  cursor  bearing 
error  from  contact  for  a typical  problem. 
Notice  the  rmignitude  oi  the  error  and 
the  constant  "lead"  errors.  Figure 
7 shows  sonar  cursor  range  error  tor 
the  same  problems.  Note  the  constant 
range  error  which  shows  a range  lag  on 
a closing  t.irget.  Figure  M shows  a 
comparison  between  three  runs  on  blar- 
ing error.  Note  the  large  variati  -n 
between  runs  and  .ilso  the  constant 
"lead"  error.  Figure  ^ shows  similar 
data  for  c*i>ir.par<it  ive  range  error.  Again 
the  variability  between  ruijs  is  evident 
-IS  well  as  the  ccuislant  r.inge  erroi  . 

Ttio  .*  riMnuing  effort,  will  rt‘;*uit  ir. 
data  n a larger  r.'.urd  .•:*  T ’ O’c..  -tc 
we,,  ar  i .arger  :•.^iI^der  f para- 
metora.  lata,  ‘ get. tier  wiM. 

id-cervati  by  m nif.-r  pcT.  -t.:.' • ; , 
will  provide  ‘he  neoe.'oary  lata  f -r 
traiiier  evuluut  i and  appl  loa*.  i '.n  f 

'Al. 
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Figure  7,  Run  I Range  Error 
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Figure  9.  Comparative  Range  Krror 
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ciwc  pMi^otmancp  on  the  Hi  Onon  ASU'  atictai^f,  iWitt’o  af  Lockheed 
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GErttCE  T.  KIK.MY 

Naval  Tralniri,’  Ejuijmt'nt  Center 
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Til*-  rol<-  of  thf  'li*  ilal  c .Miijnit'T  is 
,T»’alLy  Liicr<'a:5i.ri>'  ui  both  waji'jii  ;;yst<'ms 
th>-  traiiii.li>'  <•  juifri'-nt  usrci  t j sinulat" 
t h03f  W’-ifH)!!  syst'-ms.  Th-'  ■i.-t,oiii,'-,hi;i>' 
:viva:ir"S  In  cjtr.tiut'T  t-'Cljialo*',-  ov  r tii-'  p-ut 
f(  w yar:"  hav  nultifilb'd  th"  cipability  of 
<'ff"CtiV'- ly  .unulatln.'  the  <<■  apon 

syrt'T.s  ur-d  ty  th''  m'xi<*ni  milit'iry  fores. 
Til'-  oSa'-'ctlv"  of  tills  paivr  is  to  brLn>'  Into 
f '"or  till'  Lirpact.  of  thr  di.'it'il  conput'-r 
t-'c.'-inoio.';.-  on  tr-iininr  juijxrfnt  'uid  to 
pr.-s'Tit  tr-Tids  'uid  for'  casts  of  cofr.put'-r 
hari'i^ar-'  -ind  soft -.jar''  us'-d  in  tr'unln>’ 

■ juifr-'iit. 

I'.THlXil'JTIOt; 

iv-caus'-  Of  th-  Lr  'liiility  to  sol'/' 

• p rt  iii'-nt  ••  [uati'ons  in  r'  -li-t.inn',  'uialo/ 
c orjait  ■ rs  '.<■■!'•  oia'd  in  • 'iriy  trainin>’  d'^vics 
Ij  r.i:';'oi'it''  th'-  b'  havior  of  th'  Virious 
v hiclrs  in  'i  tartiral  situation.  Tti'- 
'u.a:  )>•  cor.putf'r-'icliv'it''-i  tralnin,’  d'.'vicr.s 
r;.'  “ff'-ctiV'  . HO'^'-v-r,  th"  lack  of 

fi'Xiiility  'Old  lin.it"d  accoracy  of  th" 

•ii.ai.,'.'  .'onjxit' r itTp  ;.'."  ! ILr.i  tatior.;'  or.  th" 

- /i'-iin,'  of  '(.'"apon  syst'-rt,. . 


E'.  iVi-  , 

th- 

.‘.'aval  Traini.'.''  .Ejuip'i'.'iit 

• nt'-r  sp  ins  jf 
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' , ability  to 

i'  V'-l'jp'  har-lwar'  ui-i  toftwar"  in  !•  f-nd'-nt  iy , 
'ind  th'-  ability  t)  tti*-  ii.'ital  i.'on.put'-r 
fir  t'-.tiri)'  th'-  "iitir'-  trairun>’  i'-vic*  . 

AdvitiC'-S  in  lii’ital  (,'0(T'.(.'ul''r  t"Ciinolo>'y 
t.'i'.'"  r- ::ult''d  in  vital  import'ince  l)"in>’  plac"'i 
on  tfi''  OS'-  'jf  th'  (."'n'  r'il-[iurpos"  di^it.al 
■ x:.[njt''r  as  a basic  tool  in  th'  fi'-ld  of 
. iruiati'on.  Ttv  ii.'ital  '.''i(iiput"r  lias 
c.intribut'-d  >.iiiiii>'a3ur'ib ly  to  th'-  "n)i'inc''!ii''nt 
of  th'  t''cimlcal  charact'-r istics 


of  training'  cjuipm'-rit  by  incraasinp  th*; 
fidelity  of  simulati'on  and  improvinj^  reli- 
ability by  the  reduction  of  el'ictro- 
mt'chanical  c<ampon''nts.  Th'i  expandin>' 
capabilities  of  th*'  dif/itai  comput'.'r  hard- 
Mdn-  have  result"d  in  a mor"  intricate  trairi- 
inr  device  which  enables  improv'd  simulation 
of  op''rational  er.vironni''nt3.  The  capability 
to  'jpiiate  conf iitiT'at  ions  -an'i  introduce  a 
variety  of  tactical  scenarios  throu^^h  computer 
pro>Tamriin>/  '.vithout  re.^uirin#^  modifications 
of  hardwari'  has  became  a eality.  Th"  lii^ital 
comp'jtpr  now  forms  the  "h'-art"  of  th'.-  m.'jd-rn 
trainin.’  devices. 

TIIAIUING  DEVICE  DIGITAL  COMPirrlLl 

In  or'i"r  to  put  the  training  ■-  {uipc.'-nt 
Digital  T"chnolo>'y  in  its  pr'ap"r  p'-rsi^'ctive, 
It  is  rc'Cessary  to  ''X'lr.ine  th"  curr'-nt 
number  of  diivital  computers  in  thi- 
Go>'nizanc''  Symbol  ”20"  inventory.  In 
Movamb'-r  196'  , only  15  >e'n"ral-purpo.^' 
liipitai  computers  haii  b'.'er,  ir.stall"d  in  the 
'.'AV71b»E'QCIfCEN' j ti'-ii. :•  . oYny  I'i'/e 

prorraminirir  lanpiays  'w-r"  r"  iuir"d  for  the 
S'-vn  rialels  Of  cam.puters  involv'd.  Txiay, 
in  contrast,  th''  majority  of  th'-  larcr 
V"hicle  simulators  pr-sently  b"in.'  procur-'d 
ar"  act  i vat'' i by  t"'ti"ra’.-p'irp  >.;e  'i;,>ital 
•.'omput'-r  . Ev"n  th"  .'itall'-r  b'Vic.'S  that 
one"  use'!  'inaloi'  S'-rv om'":h,'ini  'm.s  ar"  b'-ini' 
s.'mufactur' d U'sinr  pro.'rairi'iabl"  rr.icr.— 
pr  iC'-ss'ir  . 

I'h''  surr'-nt  NAl'TlbiE.iUli’Crdi  inV'T.’.or;.' 

-Jtisi  t.;  jf  r'-ri'-r'il-p  .rp  ii.';*a. 
'.'jr.f'ut-rS'  of  66  ilff-  r'-nt  me*!'  is  -ith'r 
install"i  or  si-.d- r contract.  Thi.;  'jc.t  l'- 
ni'-nt  in  j i.;t .:  of  50  S"C  m l '’'•n''r'it  i ar.,  ....9 
thiri  11'  ratioi.,  an!  'r'  f lurtdi  r 'it ion 

C'.m.put'  r . Th'  .,'on,put"r.  ’tr"  proi'r'imr'  i 
in  differ''nt  i,'in>'uays  'inii  'ir-'  s3"'i  l a 
•ictivat'-  ..'9''  1'  vices  of  11.  liff'-r'-nt  tyj-  s. 
Th''  tr'iLnin>’  il'cvices  'ind  th'-ir  ■is;jOciat"1 
I'omput'  rs  r-' pair''  approxirr.at-'ly  ,6  ''  soft- 
wap  proi'i’an.;;  and  .a.;soci.at"d  ‘iocam''nt  ation. 
T.abl"  1 prt'S"nts  'i  summary  of  th'  .’r o'w:  !i  of 
di,’itai  .'om.puters  in  Coi-nii'.'inc"  Syr.boi  " 
trainiii)'  *‘.iui nifiit  from  L>65  t.a  J-uiuary  l'^77. 
Tabl"  . lists,  th'-  comput-  rs  by  comput'-r 
nimufactur'  i',  showiiir  th'-  puruitity  of 
coc-put'-rs  install'-d  or  und' r contract.  Th" 
incr"asin(’  numb'-r  of  .’'ai'-ra i-purpos''  Ii.'ital 
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TAIilJ-';  2 

.a-;Nmir-niRra'.K  digital  cciMinmn.; 

INGCJUXRATTTJ  IN  COGNIilANCK  GYMHOL  ".''0" 

TRAINING  Ew»J,FW;NT 

NOTi::  All  Asterisk  (•  ) pri'ccdi  3 lh'‘  Op  ratiorial  (W'-apon  Gystem)  Cotnputprs  used  in  Training' 
Eiuipcn-'iit. 


MANlTACniRI-31 


AMn-ri^R 


MANUFACTURER 

QUANTITY  INGTALIiJ)  QUANTITY  INGTALUiD 

imiJi  COUJHACT  COMlVTtR  OH  UNDEJi  CONTRACT 


Ctunput'T  Gignal  lYocf'ssors.  Inc. 


CSP-30 

9 

Control  Data  Corn. 

CDC-3100 

1 

CDC-i6i)LB 

1 

•CDC-SLOOC 

4 

•CDG-^LOOL 

2 

Data  >neral 

NOVA  210 

1 

NOVA  800 

17 

NOVA  1210 

1 

NOVA  1220 

1 

Super  NOVA 

1 

Digiac  Corp. 

CT-10 

75 

Digital  Equipment  Corp. 

FDP  8/E 

1 

TOP  11/05 

4 

fDP  11/15 

1 

IDP  11/35 

2 

roP  11A5 

89 

IDP  11/50 

2 

>'neral  Precision 

GPL 

4 

GPLB 

3 

Harris  (Datacraft) 

DG-602J./1 

4 

DC-6O24/4 

6 

DC-602L/5 

11 

Hewlett  PacKarvj 

HP 

5 

Honeywell 

f*-316 

11 

H-716 

23 

H-80<j 

2 

13 

DDP-116 

1 

M)P-12L 

13 

DDP-22M 

4 

DDPW»16 

5 

DDP-516 

82 

fflM 

Mj37ASM-91  (IBM  TC2) 

2 

•AN/ASQ-155  (IBM  L-PI) 

2 

•AYA-6  ( IBM  4-PI ) 

3 

Into  rU  at  a 

Inteniata  6/I6  20 

Interdata  7/l6  2 

Interdata  8/32  11 

Litton 

•AGA27A  (L-3OL)  3 

MicroGystcms,  Inc. 

Micro-810  U 

Raythe on 

PB  250  U 

RAY  7OL  3 

RDS  500  2 

Gperry 

•AN/AYK-10  (Uni vac  I832)  7 

An/uYK-7  8 

AN/UY1^20  6 

CP-642A  5 

CP-642B  2 

•CP-901  5 

UNIVAC  1230  6 

UNIVAC  9300  1 


Sylvan! a 
CP-642B 

Systems  Eiigr  Lap 


3EI^5  1 

SEWI6  ^ 

SEl^lOA  1 

SElr-eil  5 

SElr4!LUA  i 

Varian  Data 

Varian  72  F* 

Varian  73  ® 

Varian  6201  F. 

Westinghouae 

•AN/AWG-IoA  CooiDUter  3 

Xerox  Data  Systems 

SIGMA  3 1 

SIGMA  5 30 

XDS-530  3 

XDS-930  8 
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C'XT;}nit«>rs  sul)st.-mt. t.hc  fact  that  wi' 
hav  • iiten'd  a p<Ti(xi  of  ma.lor  rcpro^^rammin,- 
r'-  julr-  ncnto.  !t  ia  r''alir.tLC  to  assumt'  that 
th'-  use  of  ilLt’ital  computer:',  in  traiiiLnp  devices 
wli;  coi.t.  Lnue  to  accelerate  as  stiown  In 
Fi.aire  1.  If  the  present  trend  continues, 
ttier"  -rflll  tie  ;■  , . n.  r'il-p'.;rpose 

d.i.-ltal  cucijiuters  used  In  training  devices 
by  l9f?l. 


The  ,-r  ivrth  In  the  nuir.ljer  of  general - 
purpose  dlrltal  computers  has  presented 
loplstic  support  problems.  Factors  contri- 
buting to  ttie  liuT'len  of  training  enulpm.ent 
support  Ln.’i'udes  the  Increase  In  the  number 
if  propr'iirar.Lnr  laniaiares,  the  Increase  In 
tile  number  of  different  computer  mcxicls, 
Increas'  In  the  numlier  of  ci^mputer  manu- 
facturer , the  increase  in  memory  size  of 
the  comptiters,  and  the  increase  In 
complexity  of  the  weapon  systems  belnp 
• ■Lmulated.  irowt.h  trends  for  the  number  of 
pro.T'cr. Inp  I'lninapes^  variety  of  computer 
mxiels,  and  the  numbe'r  of  cotiiputer  m.anu- 
fact'orers  are  showii  In  Fiiaire  2. 

The  increase  In  computer  memory  size 
re  julrements  'ind  the  CiXripLexlty  of  the 
weapiin  system  belnr  simulated  Is  demon- 
:;trated  by  comp-irlnr  one  of  the  e.arlier 
digital  coc.puter  activated  training;  devices 
with  a pre:jent  day  system.  The  device 
. r' ' A,  .1— i 1.  «■  ipxi  jyste;-  Ti'alner,  was 
delivered  In  1966  with  a Fo-oi/O  computer 
containing  ,120  words  of  memory.  Device 
L'.illV,  .l-iA  Positional  Trainer,  was 
recently  delivered  with  Id  IDP  ll//*5 
c.xiputers,  3 C3P-d0  computers,  'ind  one 
AIJ/UYK-IO  ciomputer.  One  of  the  it)P 
computers  contains  approximately  94,000 
Words  of  cx-mory.  D>.-vice  2F101,  T-2C 
Up-'rational  Flii-ht  Trainer,  represents  a 
typical  it.ixiern  training  device.  This 
device  contains  four  IDP  11/45  C’Xr.puters, 
each  with  a capacity  of  46  thousand  words  of 
cori  memory.  In  addition  to  the  core  memory, 
each  cocijiuter  C.'in  access  a 500  thousand 
word  disc  to  obtain  utility  'ind  dia,^ostic 
propr;im:,,  to  reprieve  overl.ays  from  disc, 
and  to  lo;id  the  main  trainer  propram  from 
disc. 

MICHOniOCHl'iOh  TKCHIlOLarif  in  ikaining 
EgUIlWlNI 

Iwirpe-scale  Inteprated  circuits  in  the 
form  of  microprocessors,  semiconductor 
memories,  ’ind  logic  arrays  are  now  being 
utilized  in  training  equipment.  This  latest 
evolytion  in  technolo»^  is  the  result  of  the 
efforts  made  by  major  semicontluctor  suppliers 
to  gain  a share  of  the  computer  mark*;t. 
Microprocessors  have  b<jen  readily  available 
for  about  y.  ■•.r.  . Mi  croproc  ssors  .and 


Figure  1. 

Crowtii  of  Digital  Computers 
Used  In  Training  Devices 


Figure  2. 

Computer  Manufacturers  (CM),  Mc'dels  (ML) 
and  Programming  Languages  (HL)  Used  in 
Training  Devices 
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■issaci.itfd  ohipr.  ir*’  b*'in/  usci]  Ui  th>' 
follawiru-  tninln^’  ii<'vicos: 

fi.  l>’vi.c<’S  I'jul.tA,  mi  IVjlAH 

•irp  ,!CA  M'lvuu’  K.'i(iir  T'iO’fL  i'y'n>T-'itors.  K'lch 
ij.'Vic”  a pro»-’ivu;ir.'il)l.'-  microromput'T  as 

t(if  h'''irt  of  till'  syst."tr,.  rh'T>'  -iv  approxi- 
T.ati'fy  170  of  thf'S'-  .i>-vici-b  uivI'T  contract. 

i . IV'Vicr  l.'.b.'Vi  Ohipl’oani  Acoustic 
Irocasor  Ti-ain-  r,  contains  a j^rn'-ral-purpuS'' 
ciixr.jiut'T  whicii  controls  a function  ^’^norator. 
TaLil''3  ar-  us''d  in  the  t^'-n'-ration  of  various 
tri.-onony-tr ic  function  mi  pseuior-'inioir. 
numlvr  t-enerators.  The  tables  hav  been 
preproi’rammed  'oy  the  contractor  in 
projT-'irir.abie  KOHs. 

c.  ti  vice  2Fil7,  K-LiA  Weapon  oystem 
Traiiier^  includes  a oEL  3e/''5  computer  aiui  a 
CDC  V.'-Al  computer  that  accepts  airborne 
oi»-rational  tap'S  whicti  are  adapted  to  the 
trainer.  A microprocessor  is  utiliv.ed  to 
inti  rface  th’-  oEL  3^/55  computer  to  the 
IDG  ‘iuOO  c xTifiut-  r. 

Microprorrmimable  computers,  utilizing 
microprocessor  teciuioloi^',  are  also  berinninj' 
to  app'-ar  in  training  levies.  Ex.-imples  of 
rr.icroproi’r'irr.able  cixr.puters  useii  in  trainin*’ 
d-vice'  ari  : 

;.  I>  vice  ,.'B3eA,  b3A  W’-apjn  Gyst’-m 
Train'-r  Visual  Attaciamerit,  .'uid  Device  2F106, 
e.-i-.  F »■  apjn  Gystem.  Train'-r  Visual  Attach- 
rrie.'.t,  utilize  a V'lri'in  73  microprorr'inmable 
c iT-put'-r  as  th'-  he-irt  of  th"  trainer^.  The 
Vari'ir.  7>  op*'rati'jn  code  set  consists  of  th" 
V-iriaii  6. '.'1  Of»'rati-)n  c-.xi"  set  prorr'imnz-d 
j;.  a KDK  memory. 

t . I>  vice3  7131/1,  tlectr  jma,-n"tic 
■It iK;ulator ; 10A3/1,  EGM  IVainer;  IOA3/.'’, 

:/;K  Trairi'-r;  md  10A3/3  Electr'anic  Warfar' 
Gii-nal  IVactice  Trainer  each  utilizes  a 
m;  -r  jpr  i.'r-imr  able  HR-’ICWA  computer  as  the 
central  part  of  the  trainer. 

Mi-sroprocessors  md  microcomputers  'ire 
pr'-s'-ntiy  supplement  in,’  th'-  conv’Tit  ional 
minicon.put'-rs  md  midr.'inp'-  con.puters  in 
m'lny  applications.  It  is  mticipati'd  that 
micr  jprocessors  'will  exp-ri-nc''  heavy  util- 
ization in  smaller  d'^vices  that  wre  d’'si)’n'-d 
usiiii’  'liialo,’  e-^uip:i’-nt  in  th''  past  years. 
J'r«'itchin,'  sp'"d  -ind  support  pr-Jbl'‘ms  for  micr')- 
compjters  ar-  pr’-vritinp  them;  fr'omi  replacing 
th'  m.inicom{xjt''rs  'uid  l'ir,’"r  computers  in 
trainiii,'  ")uipni''nt  on  .'i  si,’ni  f ic'uit  scale  at 
th’-  pr'-b'-nt  tim'-. 

Mi'-roj'r'ocessors  r’'main  th'-  "hottest" 
d"si,-ri  subject  in  ''D'ctr'anic;!,  -'ind  ar"  lik'-ly 
to  remain  such  for  sijm'-  timi'-.  How-vr,  th'- 
bo'om  of  til''  microprocessors  does  not  C'SCk- 


without  siome  problems.  The  software  support 
of  th''  tr.icroproKr.-jmmiable  processors  will  b" 
'I'ori''  by  a 'l'03i^rn'''r/pror:rammer.  The  desi(!;n''r/ 
pr'),’r'iiTj..'*r  -will  implem''nt  his  design, 
previously  accomplished  with  hariwir'.'d  loj^ic, 
throuo’h  'On-line  protorammini'  of  th''  micrio- 
processor.  Instead  of  usino'  AMD,  (JR,  NAHD, 
m-i  NGR  loo’ic  rates,  th"  desim"r/prorramni''r 
will  US"  mask,  compare,  and  Jump  instructions. 
Most  microprocessor  applications  re-juire  a 
mixturi'  of  control  op-rations  md  application 
con;putations  which  ar"  interleaved  in  the 
b'ody  of  the  propram.  f-t'rsonnel  without  a 
backpr-ound  in  both  hardware  md  software  -will 
find  this  typ-  of  propr-arniminp  'zoctrerm-ly 
d if ficult. 

Th"  small  memory  utilized  by  most 
m.icroprocessors  and  a lack  of  p-riph'-ral 
C'luipment  will  tend  to  hinder  software 
devolopm’-nt  md  software  support  of  micro- 
comput'cr-based  training  equipm'-nt.  This 
problem  cm  be  partially  alleviated  by  usinp 
either  hardware  simulators  or  soft-war*-  cross- 
assemblers  md  editors  on  larger  machines. 

The  future  development  of  C'-)n;plete 
system  softw'ire  by  the  microprocessor 
mmufacturers  themselves  is  doubtful.  Most 
likr.'ly,  the  futur*-  developm'-nt  of  system 
softw-iT*.'  will  b'-  left  to  the  software  houses. 
This  will  r'.'salt  in  the  designer  being  faced 
with  developing  his  training  device  software 
on  crude  systems  with  clumsy  input/output 
devices  -ind  -with  little  softwac  to  support 
him.  Vendor  support  for  micros  is  far  less 
than  that  avail abl'-  for  most  of  the  mini- 
c omput'-rs  on  t-xlay's  market.  The  desi,7i'.>r 
■uid  the  support  p-rsonnel  will  consume  a 
considerable  amount  of  -additional  tim*- 
discovering  for  hims'ilf  th*a  msw-  r to  his 
:iuestiuns. 

A major  ar'-a  of  concern  is  the  logistic 
support  problems  caused  by  a proliferation 
of  hardwan-  microprocessors,  microcomputers, 
•uid  software  assi-mbly  Imimages.  N'-w  sp-ci- 
fications  -uid  changes  in  son*-  of  the  Data 
Item  Descriptions  will  b*-  r'-juir'-d  to 
provid"  a supportable  training  system,  to  the 
user. 

.lOI-TWiyib  FOR  TR-MrUNG  DEV  Id’ll 

With  th’-  '-xt-Tisive  math  nuxleling 
r’-')uir"d  in  tixiay's  training  e iuifxii*’nt,  the 
d'-ve lopm*'nt  ;uid  m'-chmization  of  algoritlims 
has  b''COm''  '’Xtr'’mi'ly  complex.  Comput'-r 
soft  wire  support  is  a major  -u-i'a  of  "xp-ris*' 
for  training  '-  (uipii'-nt  .'uid  th*'  nuxl’-rri  d.ay 
wapjn  systems.  As  gr’'ater  precision  -md 
flexibility  ar"  demmdi'ii  by  weapiii  -yst’-nis, 
ri'-w  kinds  of  iiar'jwar'-  b'-com'-  availabl'  , and 
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bud»!:et3  and  manpower  shrink,  training  equip- 
nH'nt  software  will  become  even  more  importajit 
In  the  future  than  it  is  today. 

The  rising  costs  of  training  eciuiprw'nt 
comjiuter  software  have  become  a matter  of 
concern  in  recent  years.  The  actual  magni- 
tude of  computer  software  costs  and  how  to 
control  them  have  been  subjects  of  increasing 
attention  by  managers  in  both  the  Dt'p;irtment 
of  Defense  and  Industry.  These  concerns  led 
to  the  Assistant  Secretary  of  Defense 
(Installation,  Logistics,  and  Controller) 
and  the  Director  of  Defense  Resefirch  and 
Higineering  establishing  a Joint  Software 
Steering  Ciximittee.  The  charter  of  this 
Cixanittee  is  to  find  mt'thods  for  controlling 
increasing  costs,  improving  the  quality, 
and  minimizing  the  adverse  impact  of  poor 
software  performance  on  weapon  systems 
effectiveness. 


A symposium  held  at  the  Naval  Post- 
graduate School  in  September  1973  concerning 
software  was  sponsored  by  the  Office  of  Naval 
Rf'search,  the  Amy  Research  Office,  and  the 
Air  Force  Office  of  Scientific  Research. 
Figure  3 was  extracted  from  the  proceedings 
of  the  symposium  and  shows  the  likely  trends 
in  the  relative  costs  of  hardware  and  soft- 
ware. In  the  late  1950' 3 the  software  was 
only  20  to  30  pi'rcent  of  the  cost.  At  the 
present  tinv!,  software  is  from  70  to  30 
pf.’rcent  of  the  total  system  cost.  D'uring  the 
1980'3,  software  cost  will  continue  to  rise 
until  it  reaches  9^1  p<’rcent  of  the  total 
system  cost.  The  relative  importance  of 
software  maintenance  is  reflected  by  the 
overlay  on  Figure  3,  Approximately  60  per- 
cent of  the  total  hardware/software  dollar 
will  be  going  into  software  maintenance  by 

1985. 


An  Air  Force  sponsored  study.  Infor- 
mation Processing./Data  Automation  Implication 
of  Air  Force  Command  ;ind  Control  Requirements 
in  the  19d0'3  (CCIi^-85)  provides  quite  an 
extensive  analysis  of  computer  software. 
Although  the  report  (CCI!'-85)  deals  only 
with  the  Air  Force  software,  the  findings  are 
fairly  representative  of  other  services. 
During  fiscal  year  1971?,  the  Air  Force 
invested  som-where  between  $1  .-ind  $1.5 
billion  on  computer  software,  compared  with,,^ 
fJOC  to  tUOQ  million  for  computer  hardware. 
Software  repre'sented  70  p-rcent  of  the  1972 
A.r  Force  investment  in  ADP  systems. 


) 


A study  was  made  during  i97A  by  the 
Institute  for  Defense  Analysis  concerning 
Autxnatic  Data  lYocessing  (ADP)  costs  in  the 
D<  fense  D<'partm»;nt  (DC®).  Reported  costs, 
plus  burden,  provided  a figure'  of  12.3 
billior.  f r ADP  costs  in  Fiscal  Year  1973* 
This  figure  was  extrapolated  to  cover  the 
reported  and  nonreported  cost  of  all  DOD 
computer  systems  and  is  shown  as  Table  3. 


Fi,-ure  ^ 

Hardware/ooftware  Cost  Tr'-nds  ' 


TABU';  3.  TOTAL  ADP  COOT  ECTIMATU:  IN  1373^^^ 


Air  Force  Annv 

N.av,' 

other  DOD 

DCO  Total 

Software 

Il.'i-tl.3  $0.v_$0.8 

tl.'J-$I.3 

50.2 

$•  • ' • 6 

M.'iT'lware 

$'-i.a-i0.5  $0.' 

$0#  3“i ' '*5 

50.1 

(dollars  in  billions) 


NOTF:  Ir»lividuai  entries  do  not  su/ri  to  total  because  of  roiuiding. 
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Th''  h'lr'iw.'irt'/aoflwarc  cost  trends  for 
trainm^’  ejuinnent  .■ipp>';irs  to  be  similar  to 
that  ''xj»’ri<'no''d  in  other  IXX)  Weapon  Systems. 
rlxf»’rLence  at  the  IJAVTRAKyUIPCEN  shows  that 
the  initial  cost  of  software  runs  from  two 
to  three  times  that,  of  the  computer  h.ardware. 

Thie  discussions  .above  }»-rtain  to  the 
direct  cost  of  softwar'  . The  indirect  costs 
of  I ;ftware  are  even  greater.  During  the 
197.-7'  tlmi'  fr.ame,  it  cost  approximately 
I"',  f»'r  instnictioti  to  develop  Air  Force 
Avionic:'  soft'ware,  but  the  maintenance  of 
the  softwar-  has  cost  up  to  tl.,  «X)  p.  r 
jist  ruction.  (■  ) cost  of  maintfiining 

much  of  tri>'  older  softw.are  products  is  an 
oni-  r d'  m.-if-jiilude  I'lrger  than  production 
cost,  u'ue  to  fxjor  desipn,  structure,  atid 
( r xiuction  control,  rro^'rajnnin/,’  costs  also 
-nen-ases  drastically  when  either  memory 
capacity  or  rrK'morj-  tinvi  is  nearly  used  up. 

•x  c.ause  of  the  increasing  .'imount  arKi 
hirh  cost  of  softwar-  required  for  traininp 
••  juifr;-  nt,  it  has  l)<r-come  necessary  to 
-•rr.phasic.e  softw.ai---  di  velo[)ment,  maintenance, 
■in<i  mouif ication.  The  I>-partment  of 
D-  f-'.’ise  a.-'-ncies  have  funded  a numb«-r  of 
studies  -inii  hi-ld  conferences  concerning’  the 
prob*-.ms  encount-.-red  in  softw.are  development. 
Th*  !:..st  pr-'valent  problem  'unonp  those 
iientifi--d  in  oftw.-ir‘'  developm<-nt  is  the 
andiscipi ln--d  ipproach  wliich  is  reneraliy 
taker..  Wh-  r.  aruiiscipiuied  approaches  .are 
utili.-ed  in  -lesii-ninf’  'ind  implemi-ntinfr  soft,- 
w.ar-  , ttie  resuitinp  softw'ir--  systems  often 
become  a nsphtmar-'  for  the  softw.’ire 
personnel.  ndistipl ined  implementation  of 
• ftwar-  a..30  impairs  the-  usefuloiess  of 
.uftw.ar-  desiiin  r-'Vi-  ws. 

I 'lx,  ' softw.-ir-  c jiiiTi'anily  spr-nds 
-■ntir-'iy  too  much  tirm-  in  testint"  and 
debu>-pinp  softwar-,-  .'ind  not  •■nou^dl  time 
deii,7iui,-  it.  Th--  avera^a-  cost  of  analysis 
•tnd  desi.ui  for  software  production  is  32 
;x  rcent  of  th--  software  cost;  the  coding 
■ind  implem’-ntat ion  averages  ^ percent  of 
the  softwire  cost;  and  checkout  .ind  test 
a'/erages  .u.  [x-rcent  of  the  total  cost  spent 
for  software  pnxiuction.  Approximately  irO 
to  7'’  [x  rcei.t  of  the  checkout  aiui  test  cost 
is  incurred  b*.-cau3e  of  bugs  left  in  from 
the  analysis,  design,  and  impierm-ritation 
phas*-.  TTie  greatest  opportunity  to  obtain 
improved  software  at  a reduced  life  cycle 
cost  is  tfirough  improved  analysis  arxi 
design  techni'}ues.  For  systems  as  complex 
as  our  digital  computer  controllf:d  training 
e.juiprx-nt,  only  a cle.’in  .ind  compelling  design 
■will  prevent  the  computer  program  from 
becoming  a mass  of  confusion  arxl  frustration. 


Mriny  Cfxiipanies  are  moving  toward 
utilization  of  structured  techniques  in  an 
effort  to  develop  a disciplined  approach 
to  softw.are  design.  Wliile  the  companies 
practicing  structured  progr-’niming  ar--  still 
in  minority,  there  has  been  a relatively 
wide-spread  utilization  of  this  technique. 

One  of  the  largest  projects  to  use  stnuctur-d 
programming  techniques  was  the  mission 
simulation  system  used  as  p.art  of  the  Sky.ab 
operations.  Approximately  /»00,000  lines  of 
source  code  were  produced  using  this 
technique.  The  results  were  signific-ant ly 
higher  productivity  than  that  previously 
experienced  using  conventional  techniques. 

Structured  software  design  is  not  a 
"cur-'-ail"  for  the  ills  of  training  equipx- 
ment  progranming;  however,  it  could  b*-  a 
p<ositive  step  in  reducing  the  Life  cycle 
cost  of  software.  Structur-:d  softwar*-  should 
he  easier  to  understand,  debug,  and  maintain 
th.an  conventional  soft-ware. 


There  are  other  teclinological  ar-.-as  ii. 
which  research  is  b-’ing  conducted.  The 
I>-partm(-nt  of  I>;feri3e  is  sponsoring  attempt  ; 
to  develop  "automatic  programming 
systems"  ^ ’ 'to  replace  the  functions  that 
are  currently  fx.-rform'.-d  by  programmers. 
Automated  Aids  have  been  developed  to  support 
•,op-;own  structured  programir.uig.  A Coile 
Auditor  progr-am  for  Automated  St.and;irds 
compliance  checking  is  another  softwar-- 
developm-.-nt  aid  of  r*:-cent  inter-'St.  Some-  of 
these  new  teclinologies  have  pot'-ntial 
application  to  r-jducing  the  cost  and  improv- 
ing the  .quality  of  training  equipment  soft- 
w.are systems. 


The  majority  of  the  training  devices 
are  programmed  in  assembly  laiuaiage.  Geverai 
of  the  trainers  are  progr;imm-d  utilizing 
either  the  Cl)-!  or  ck'— i’  profTarmir.g  language, 
born*-  of  the  curn-nt  training  device  programs 
have  been  developed  utilizing  H3RTKAN 
Mixiules. 


The  University  of  Florida  has  investi- 
gated the  characteristics,  syntax,  ajid 
constructs  of  a higlt-order  language  for  real- 
tinx’  trainers.  This  work  was  pt-rfornn'd  under 
contract  to  th--  rjA'.TRAKQUircEN.  The  report 
prepared  as  a result  of  the  study  was  titl-'d 
"Real-time  PASCAL."  Real-time  PASCAL  is  an 
enlianceme-nt  of  the  r(-).':u'ar  PAdCAL  language 
and  retains  the  style  of  PASCAL. 

The  Di-partment  of  IV-fense  has 
established  a standard  high-order  language 
working  group.  The  goals  of  this  working, 
group  W’-re  to  formulate  requirements  for  a 
:itamlard  high-order  lan^-aiage,  evaluate 
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;•«!.—  it;  tf.iil.ty  11-  ri'iuir'-  niiic.-ii 
r-«r.',n,-  f ipritin,-  .;y  ti-ms,  suprvisors, 
L-*i  • r,i  r 'yp  -f  utility  .'iflwir-. 

rti-'  !i.-i,7vtlc  '-or-i  T'  xalns  tho  moot 
pipu.’ir  pri.r;.-iry  im-mory  In  trii  'lavy  cotr.fiutnr 
ifiv- i.t  iry.  Tliis  is  pr ini.-tri ly  bocause  of  its 
i-i- 1 1 -itii  1 ity  -mil  nonvolatile  n.aturi'.  The 
".■mieti'-  li.ik  is  the  riioot  fKipul.-ir  secondary 
(ras:  -ni-dia)  m>-x.ory  utilized  at  this  till*'. 

Til-'  cost  of  topic  'inil  inteprat'.'d  circuit 
memory  is  decreasinp  at  such  a rapid  rate, 
it  would  app-.-ir  that  tiie  inteprated  circuit 
rx-mory  wiii  replace  tti"  disk  as  tiie  secondary 
r.ass  nv-mory  media.  Howevr,  disk  is  about 
one  -iixl  orie-h.alf  ori-  rs  jf  ma.-nitude  more 
dense  than  the  int'-prated  circuit  memory  and 
about  tiiree  order,  of  m'lpnitude  cheap  r.  ( 

It  is  I'uiticipated  that  the  disks  will  improve 
as  fast  as  the  inteprated  circuits  memory. 


It  is  anticipated  that  bubble  memories 
will  soon  appoir  in  commercial  pr'Xiuct;.. 
Hubljle  mi-mories  consist  of  a thin  oi'thopona! 
film  in  wbicii  each  bubble  is  a 

cylindrical  ma,aietic  domain  tiiat  carries  a 
polari/ation  oppjsit-  to  that  of  tiie  fi  in.. 

Hie  bulji/L'.'S  are  about  t.hree  microns  in  .il.e- 
and  call  tie  packed  in  densiti-'s  up 
mi  U ion  liubi,l<;s  per  s piare  Lnch.v 
Hubble.  m<'mori'  S siiould  I'.-.'ni  to  ]ar,'er  and 
faster  nx-morles.  Thi.  t'-ciuiolo.y^  Is  a 
si,aiificant  contend-  r to  tti*.-  disk  ar-:a  sine-- 
they  provide  nonvolatile  data  stora,-’  . The 
disk  app-.ars  to  be  sal'e  from  thl.i  t-.-ctinoloiiy 
t.hrou,’h  the  e-irly  1780' s. 

The  semiconductor  devices  that  will 
form  the  mainstream  computer  technolopies 
durlnp  th--  next  decad-'  are  tiv-  com.pleinent-iry 
metal  oxide  semiconductor  (CMO.l),  bipolar 
iichottky  tr.ansistor-transistor  lopic  (ITI.), 
■inti  the  int'-prated  injection  lopic  ( IIL). 
CMO;',  has  hip-h  p.-rform-ance,  extr'-nv-ly  low- 
piW'-r  dissipation,  a sinpL-i  pow-r  supply, 
wide  op-ratinp  r.anpe  with  resp.-ct  to 
t-  mp-rature  and  voltape,  ,and  high-noise 
imr.unity.  The  .-itlvantages  of  TTL  are  low 
cost,  pood  p-rformance  for  a wide  virity  of 
applications,  l.arge  numb  -r  of  est-ablished 
suppliers,  and  the  fact  that  most  desi.-n 
enpineers  are  familiar  with  this  tec.hnolory . 
Tlie  .Ichottky  TTL  also  has  the  spie-i 

•ind  environmental  reliability.  Althouph 
IIL  is  new,  it  has  ,-reat  potential  in  the 
future.  It  has  the  sp-ed  of  the  bipolar 
circuits,  the  densities  of  CM(X'.  circuits, 
and  one  one-hundredth  of  the  po-wer  consur.fi- 
tion  of  TTL  circuitry. 

It  is  projected  that  the  nitcrocomput---rs 
will  be  utilized  to  a much  i-arger  extent  in 
traininp  devices  dui-ing  the  next  decade. 

The  main  ar-.-as  of  their  use  will  be  to 
supplement  the  present  minicomputer  and  mid- 
ranpe  computer  architoctur-,-,  and  as  stand- 
alone computers  to  replace  the  smaller  analog 
device-.  Microprocessors  will  continue  to 
replace  the  h.-irdwlred  ae.)uential  and  combi- 
natorial logic  circuits  in  both  the  digital 
computers  and  thi-  other  training  e juipn- nt 
eiectronics. 


Tile  dnar.-  -Joupl-'d  I>  vie-  (CdU)  has 
presently  gained  .'in  entry  into  the  secondary 
nx-raory  m.-irto-t.  The  COD's  are  sonR.-what  similar 
In  op-ration  to  th'-  delay  Line  memory  --ind  are 
volatile.  As  with  other  volatile  memory,  .-in 
auxili-'iry  jxjwer  source  c-an  be  incorporated 
into  the  unit  enabling  the  user  to  rest;u-t 
his  program  without  having  to  reloari  the 
mf.'ffiory.  It  is  not  anticipated  that  CCD 
mi-mories  will  beconx-  a major  tlireat  to  disk 
memories  until  the  mid-l')8()M. 


To  r*'duco  some  of  the  softwar--  cost, 
certain  asp-cts  of  solTw.are  design  such  as 
op-rating  systems,  will  be  Incorporated  Into 
the  b,'irdw.are  system.  It  is  anticipated  tha(. 
more  automatic  reconfiiairation  and  automatic 
shutdown  and  restart  will  be  built  into 
h.-il'iiware.  As  th"  systems  bt  come  more  complex, 
there  will  be  a tend.-ncy  toward  more  .-lutij- 
matic  -and  remote  maintenance  techniques 
being  utilized.  Come  of  the  remote  mainte- 
nance capalii  1 it les  ar--  in  computers  presently 
tx'lnp  fumounced  for  marki-tiiig.  It  is 
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that  traLiiiiip  t.'ijui pnxTit  will 
make  usf  of  thi’SO  features. 

A!th')u^•h  thi'  rat>-  of  ^rrowth  of  softwar*- 
11'  coiu^t.'uit  ly  iticr"asi tu’,  r-'Si-areh  and  d<'v>‘l- 
oi.n>  :it  Lii  thia  ar'-a  haj  a'-rioualy  la^’^i'd  bi  - 
hiiki  that  of  hariwar*'  J”V>’lopiii'Tit.  The  futur*- 
[!roJ*'Ct>ai  .-rowt  h of  lh>  coni}iut>T  industry  is 
b.apfii  on  continuous  broaktlirourh::.  in  th>'  st.at<  — 
of-th' -art  for  b ith  soft  war'"'  and  hardwar<'. 

This  will  rujuir’'  ri'allocation  of  p-TSonir’l, 
t im-  , -inii  fuikis  to  assure  that  software  is 
•■rOf»'r.y  -uidressed  in  the  future. 

Tile  future  applications  programs  will 
likely  t.e  far  more  c.ataplex  than  the  present 
S -ftware.  ity  the  l lBtl's  trainiiuT  equtpuient 
software  pack-apes  will  include  pro/T/ims  to 
tut  r user;  L’l  the  -j-oa  of  on-line  docum- 
nient at  iotj,  'uid  prorraaii'.  to  restore  ^inri 
reconfaiiire  the  traininr  device  durinp  'ind 
■ fter  IriT'iware  failur-  . 

Tl.ere  will  be  c;ai,y  st'indard  utility 
propr-uT..-  offere'l  in  firmware  in  the  future. 

T?iis  will  be  in  the  font,  of  microprocessor 
chip.'  and  KclU's. 

In  the  ri'  ar  future,  traininp  equip- 
ment computers  wiii.  have  the  capability  to 
• xeeute  a tiip.'i-or  h-r  lanpuape  directly  fi'omi 
so-.j"ce  c jil'  . The  M'»!erri  Klectror.ic 
T'  -''siol  >,y  1 imp’iiter  .Mr'T-d  is  marketed  as  a 
w ■ jiit  Cii"r  icon,[)Uter  ttiat  directly  executes 
a FUHT:tA.’i— » i .<•  hi.’.’i- ley,,  i l.-inpuape.  (1-^) 

n.e  „t,r..-t  -red  S'  ftw.’ire  lesipn  approach 
f -r  f v . p-t.p  aystem  software  will  provide 
•ill  i~)r  f-;.'  In  ‘t.e  debuppLnp,  te'Stinp, 

■mi  ■.  "1.  1 !ali  e.  softwiT'  • Ui-line  inter- 
ai  * -y . ter,:;  w-.l  help  alleviate  the  lonp 

t -r.nar  an!  t im,-  for  teat  Lnr.  Cross-assemtiler 
apa:  . .1*  ie  ; ar.’e  no.at  machines  a.^id  micro- 

. r , ..--irt  ' ; er.,ati.jti  capabilities  w-11  proviie 
‘..'i-  "i;.,  ■ rj  -t'  r ml  rniicrocxi.puter  users  with 
..ef  wt.e.n  ".a  ' nt  ai.nim’  a:'.i<er'bly  laniniape 
, f war-  . 

-f'.mr--  wll.  till  have  t)  be  validated 
inl  ",.a:.nta.ne  ; in  Mr-  future,  tvi,.  aut'oniatic 
; r •;  4'-*  . <f  tn-  ftwar'  for  an  entire 
y - I'r  r trc  -later. -nt  f the  pr  ilib-n 

't  j.r  for  tne  tvar  f itur.  . Tlv 

..".a;.-'  litiratic  pr»luction  of  software 
'll:  r- d'l  ■ jr;e  ,f  ttie  maintenance 
a t. x-.e  pr  .nlert.  are-i;-.  dir.' n the 
a ,t  x-.'P  . P it  i ir.  )f  sraft  wij-.-  is  jr'rferte'l, 

vaii  iat.  ant  riiiiitenance  wll:  still  lie 
rejjire;  , inre  the  peri.Tator  nu.’t  be  vali- 
date.! u,.!  r.aintalne.i. 


CONChUllIONi; 

The  cle/irest  trend  of  all  appears  to 
be  the  continuinp,  rapid  prowth  in  the  number 
of  digital  computer-controlled  traininp 
equipment.  Problems  associated  'with  the 
support  of  digital  computer  har-iware  .-ind 
software  have  increased  Immensely  since  the 
injection  of  the  digital  computer  into  the 
training  device,  f’actors  contributing  to 
the  support  problems  are  the  increase  In 
the  number  of  progr.amming  languages,  the 
increase  in  the  number  of  different  computer 
models,  the  increase  in  the  number  of 
computer  manufacturers,  the  increase  in 
memory  site  of  the  computer,  and  the  increase 
in  the  complexity  of  the  weapon  system 
being  simulated. 

Th-  computer  Industry  has  spread  its 
influence  so  diversely  and  so  rapidly  that 
it  has  been  heralded  as  a second  industrial 
r. 'Volution.  During  the  next  few  ye-'irs,  the 
compiler  industry  will  have  a strong,  continu- 
ous, and  stable  teclinological  growth.  The 
use  of  large-scale  integrated  cliips  will 
result  in  Improve-d  reliability  and  prfor- 
mtinco  .'ind  <a  reduction  in  cost  of  computer 
h.'irdware.  The  cost  of  computing  pow  r 
(cost  p‘r  instruction  p-r  second)  is  "Xp-cted 
to  continue  to  decrease  exponentially. 

Microprocessors  are  increasing  the 
accuracy,  f l.'.x;ibility,  and  econony  of 
instrumentation  .an'l  c-ontrol  systems.  These 
increased  capabilities  ;ire  opTiing  up 
applications  ranging  from  sewing  macliines 
to  military  avionics  subsystems,  such  as 
r.adar,  navigation-weapons  delivery,  'ind 
■ iectronic  countermeasures.  Micr'i- 
processors  and  microcomputers  are  be.tLru;i:ig 
to  rapidly  appear  In  numbers  in  tr  lining 
eqaipn;ent. 

The  increa.iing  demands  on  softwar-  will 
re  iuire  that  m.'magement  beconit'  mor-'  'iwar. 
of  softw.'U’e's  role  in  training  d'”ices. 

In  implementing  systems,  it  has  been  a 
tendency  to  giv  more  emphasis  to  hardwii-" 
acquisition  th;in  to  software  ac  (uisition. 

In  the  futur.  , training  eqi  ipi;..nl  software 
must  liav  e.jual  visibility  with  h,’ii'dwire. 
without  this  visibility,  purchasing  and 
m.aintaining  tr.aining  ejuipbTit  software 
will  pi’.'Sent  serious  problems. 

In  the  futur.  , ii  w w.-apon  systems  .-uid 
ch.'inges  in  op’ratlons  to  Hccixiimo.i.at.'  new 
' nvlr.jnments  -'md  situations  'will  nece;:— 
itate  niajor  cii.'uiges  in  tile  computer  h.ard- 
war"  'inii  softwar.  tti.at  niust  support  training 
e luifxti.-nt.  Til"  succes.s  ol'  future  training 
e juipiierit  ttius  I'  p'nds  on  tlie  continued 
devlop!»'nt  of  digital  comput'.r 
^•■cisiology . 

/ 

/ 
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PLANNING  AND  SCHEDULING 
SOFTWARE  DEVELOPMENT  PROJECTS 


DALE  H.  FAWCETT 

Simulator  Systems  Enqineering  Department 
Goodyear  Aerospace  Corporation 
Ak  ron  , Ohio 


INTRODUCTION 

The  planning  and  scheduling  of 
the  resources  for  a project  is  one  of 
the  most  critical  activities  for  the 
success  of  a project.  It  is  neces- 
sary for  management  to  spend  consid- 
erable time  on  this  activity  for  a 
large  software  development  project. 
This  time  is  well  spent  as  good  plan- 
ning and  scheduling  is  a requirement 
for  a successful  project.  The  sched- 
ule, together  with  a reporting  scheme, 
ensures  that  the  project  is  progres- 
sing as  expected  or  quickly  informs 
management  if  it  isn't.  The  sched- 
ule provides  a primary  communication 
channel  between  the  technical  and 
managerial  personnel.  The  schedule 
must,  therefore,  be  correct  and  meaning- 
ful to  both  the  technical  and  manager- 
ial teams.  The  monitoring  of  project 
progress  when  compared  to  the  schedule 
informs  management  of  the  project  sta- 
tus. If  problems  develop,  management 
can  be  quickly  informed  so  that  cor- 
rective action  can  be  initiated.  The 
plan  and  schedule  provides  a specific 
guideline  for  the  technical  personnel 
to  assist  in  visualizing  the  relation- 
ship of  specific  tasks  to  the  total 
project . 

To  accomplish  effective  software 
planning,  a set  of  three  schedules 
must  be  generated.  These  schedules 
are  an  activity  network  of  tasks,  a 
Gantt  chart  of  personnel  resources 
utilization  and  a table  of  computer 
resource  utilization.  The  project 
planning  and  scheduling  is  accom- 
plished in  the  following  steps; 

Define  and  estimate  tasks 

Generate  task  activity  network  and 
schedu 1 e 

Generate  personnel  and  computer 
resources  schedules 

Update  activity  network  with 
resource  utilization  data 

Verify  the  interactions  of  the  three 
schedu  les . 


Many  projects  have  had  a good 
plan  and  schedule  of  tasks  to  be  ac- 
complished and  have  failed  to  be  com- 
pleted on  time.  One  of  the  causes  of 
this  failure  is  the  lack  of  a resour- 
ces utilization  schedule  which  is  in- 
teractive with  the  task  schedule.  The 
limited  personnel  and  computer  re- 
sources must  be  carefully  accounted 
for  in  the  overall  project  plan.  The 
planning  and  scheduling  method  must, 
therefore,  account  for  the  character- 
istics of  software  development  and  the 
interaction  of  limited  resources  upon 
the  task  schedule. 

The  plan  must  also  be  flexible  to 
accommodate  schedule  adjustments  dur- 
ing the  project  caused  by  inaccurate 
estimates  or  unexpected  events. 

The  planning  of  a software  devel- 
opment project  begins  with  defining 
the  tasks  to  be  accomplished.  Then 
estimates  of  the  resources  for  each 
task  are  made.  Finally  the  interde- 
pendencies of  the  tasks  must  be  des- 
cribed. The  scheduling  of  the  pro- 
ject can  then  be  accomplished.  The 
schedule  must  account  for  the  tasks 
and  utilization  of  the  resources.  As 
the  t-roject  progresses,  the  plan  and 
schedule  must  be  modified  if  necessary 
to  reflect  the  project  status  and  any 
new  de ve 1 opmen t s . 

TASK  DEFINITION 

Based  on  the  functional  and  de- 
sign requirements  of  the  system,  the 
software  design  can  be  established. 
Using  a "Top  Down  Technique,"  the 
software  is  decomposed  into  hier- 
archical tasks  each  of  which  can  be 
clearly  defined.  The  decomposition 
process  consists  of  subdividing  each 
task  into  the  next  level  of  detail. 
Each  task  at  the  lowest  level  of  de- 
tail consists  of  specific  actions  such 
as  design,  code,  debug/test  or  inte- 
grate for  each  distinct  program  en- 
tity. The  level  of  decomposition  is 
of  course  variable,  dependent  upon  the 
overall  project.  This  level  must  be 


(I p I d i 1 1? d e n 0 u (j h to  provide  a c a p a I)  i 1 - 
tty  of  timely  mon  i t o r i n<j  . If  the 

tdsi'  hreakdown  is  at  too  high  a level, 
the  project  could  be  significantly 
behind  schedule  before  management  is 
informed.  If  the  level  of  decomposi- 
tion is  too  low,  the  planning,  sched- 
uling and  tracking  of  p r o (j  r e s s be- 
comes an  unmanageable  task  because  of 
the  excessive  paper  work.  B a s i c a 1 1 y , 
the  level  of  decomposition  should 
provide  visibility  in  the  time  frame 
of  the  schedule  for  progress  report- 
ing to  management.  For  example,  if 
management  should  be  made  aware  of 
progress  on  a bi-weekly  basis,  then 
specific  tasks  should  have  a duration 
of  from  one  to  four  weeks.  This  lev- 
el of  decomposition  should  not  be  a 
burden  of  record  keeping  and  should 
be  adeguate  for  management  to  see  and 
real t to  problems  so  that  corrective 
action  can  be  taken  in  a timely  fash- 
ion. In  a large  project  with  several 
levels  of  nanagement,  different  sched- 
ules oriented  toward  each  hierarchical 
level  of  tasks  may  be  required. 

During  the  planning  stage,  all 
tasks  must  be  anticipated  because 
errors  of  omission  can  be  at  least  as 
costly  as  errors  of  commission.  It 
becomes  very  difficult  and  costly  to 
have  to  add  unplanned- for  tasks  after 
the  project  has  progressed  downstream. 
A careful  top-down  analysis  of  the 
problem  should  define  all  necessary 
tasks  at  the  beginning.  Fxtra  atten- 
tion must  be  given  to  tas  rs  and  pro- 
grams which  are  required  to  support 
the  main  effort.  These  secondary 
tasks  are  frequently  omitted  from  the 
original  plans  for  projects,  but  they 
must  however  be  performed,  and  will 
require  both  personnel  and  computer 
resources.  Because  of  the  dependence 
of  main  progranis  on  the  support  pro- 
grams, support  programs  must  be  com- 
pleted prior  to  the  main  programs. 
Therefore,  accounting  for  the  support 
programs  at  the  first  stages  of  de- 
sign is  very  important. 

ESTIMATING 

Each  of  the  tasks  should  be 
identified  and  clearly  defined  so 
that  a valid  estimate  of  the  required 
personnel  and  computer  resources  can 
be  made.  With  inaccurate  estimates, 
rescheduling  will  be  done  frequently 
as  the  project  continues  until  valid 
estimates  are  made.  This  activity 
prevents  management  from  clearly 
seeing  what  is  happening  and  from 
making  rational  decisions.  Estimates 


are  not  perfect,  but  they  must  be 
reasonably  good  for  a plan  and  sched- 
ule to  be  effective.  Methods  of  esti- 
mating software  are  quite  varied. 
Lstimatini]  methods  range  from  the  use 
of  accurate  records  on  previous  pro- 
jects to  uneducated  guesses.  G p e M - 
fic  techniques  for  estimating  are  be- 
yond the  scope  of  this  paper,  but  it 
is  assumed  that  the  estimates  are  de- 
rived from  the  best  available  tech- 
nic] u e . 

The  estimating  should  be  made  in 
a bottom-u[>  fashion.  The  lowest  level 
tasks  are  estimated  first  because  they 
iiave  the  most  specifically  defined  de- 
tails. These  estimates  are  then  sum- 
med to  provide  the  estimates  for 
higher  level  tasks  and  the  total  pro- 
ject. The  bottom-up  estimate  should 
be  verified  by  comparison  with  another 
estimate  such  as  a top-down  estimate. 

A top-down  estimate  is  generated  by 
evaluating  the  total  project  effort 
in  siye  and  complexity  by  comparison 
with  previous  projects.  Each  specific 
task  should  be  estimated  in  person 
day^  or  weeks  and  computer  resources 
in  hours  required  per  week.  The  per- 
sonnel resources  estimate  must  in- 
clude ttie  number  and  type  of  person- 
nel required  and  account  for  training 
or  tamiliariyation  time  needed.  The 
task  estimate  will  indicate  the  time 
required  for  each  person  and  the  total 
task  duration.  The  computer  resources 
estimate  must  include  CPU  time,  termi- 
nal use  time  and  any  other  significant 
resources. 

Once  these  estimates  are  made, 
they  should  not  be  modified  unless 
the  modification  can  be  justified  by 
new  data  affecting  the  estimate.  It 
is  assumed  that  the  most  reliable 
method  and  information  available  was 
used  in  the  generation  of  the  esti- 
mate. I t, therefore, does  not  make 
sense  to  shorten  the  time  required  to 
accomplish  a task  even  if  a resched- 
uling causes  it  to  start  late  and 
someone  wants  it  to  complete  on  time. 
This  activity  of  trimming  a valid 
estimate  has  led  to  many  panics  be- 
cause a project  appears  to  be  on 
schedule  until  the  end  and  suddenly 
is  far  behind.  However,  if  new  valid 
information  affects  the  estimate  and 
tfie  change  is  justified,  it  should 
certainly  be  made.  Deliberately  ig- 
noring valuable  information  which 
causes  a change  to  original  estimates 
seldom  leads  to  success.  For  a plan 
and  schedule  to  be  a useful  tool,  it 
must  be  maintained  as  accurately  as 
possible. 
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NL  TWORKJ  NG 

P ro(}ramm  i ng  is  fln  activity 
oriented  process,  consisting  of  activ- 
ities such  as  design,  code,  debug/ 
test,  and  integration.  There  is  not 
necessarily  a unique  event  occurring 
at  the  termination  of  each  activity. 
Thus,  it  is  more  appropriate  to  con- 
sider the  jctivities  than  the  events 
such  as  completion  of  documents.  The 
task  schedule  must,  therefore,  be  an 
activity  oriented  schedule. 

Another  important  characteristic 
of  software  development  is  the  inter- 
dependency of  the  activities.  The 
tasks  for  each  module  must  be  per- 
formed in  a designated  sequence  and 
one  task  cannot  be  started  until 
another  is  completed.  The  various 
design  levels,  coding,  test/de bu<j,  and 
system  integration  tasks  must  be  ac- 
complished in  a chronological  se- 
quence. There  is  also  an  inter-module 
dependency.  Because  of  the  top-down 
design  and  testing  technique,  certain 
modules  must  be  completed  and  inte- 
grated before  others  can  be  integrated 
into  the  system.  This  characteristic 
or  interdependency  requires  that  the 
scheduling  technique  must  be  a network 
type  so  that  the  interdependencies  of 
the  tasks  and  the  effects  of  one  event 
on  successive  tasks  and  the  overall 
project  can  be  visualized. 

The  critical  path  method  (CPM) 
is  ideally  suited  for  software  plan- 
ning and  scheduling.  CPM  is  an  ac- 
tivity oriented  network  technique. 

This  enables  CPM  to  show  the  inter- 
dependencies of  the  software  tasks. 

CPM  provides  the  calculation  of  float 
times  in  the  paths  and  determination 
of  the  critical  path,  the  one  with 
zero  float  time.  This  capability 
provides  management  with  the  rapid 
view  of  the  critical  tasks  which  must 
be  monitored  more  closely. 

After  all  the  tasks  have  been  de- 
fined, the  next  step  is  to  lay  out  the 
complete  network  of  tasks  based  on  the 
interdependencies  using  CPM.  This 
network  plan  must  also  indicate  the 
effects  of  tasks  external  to  the  soft- 
ware. The  availability  of  hardware 
or  software  from  other  activities 
must  be  indicated.  Similarly,  if  a 
software  task  affects  other  activi- 
ties, it  should  be  indicated  on  the 
network.  This  helps  to  ensure  that 
proper  communication  between  major 
activities  of  a project  is  maintained. 
If  changes  must  be  made  to  a project's 


schedule,  the  effects  of  this  on 
other  activities  of  the  project  must 
be  considered  and  the  manager  of  those 
activities  informed.  Figure  1 pre- 
sents a sample  of  a software  network. 

The  generation  of  a network  chart 
should  be  clearly  labeled,  easy  to 
read  and  follow  basic  guidelines  pre- 
sented by  O'Brien^  to  ensure  its  us- 
ability. If  it  fails  to  conform  to 
these  guidelines,  it  will  be  quickly 
d i 5 ca  rded  as  useless. 


RESOURCCS  UTILIZATION 

Another  characteristic  of  a 
software  project  which  complicates 
the  schedule  and  control  activities 
is  the  interactions  of  the  finite 
resources  with  the  task  schedule. 

The  two  primary  resources  are  the  per- 
sonnel and  computer  time.  The  failure 
to  realize  the  interactions  of  finite 
resources  with  the  task  schedule  has 
led  to  severe  difficulties  in  many 
projects . 

Because  of  the  nature  of  software 
development,  personnel  cannot  be  ran- 
domly reassigned  to  tasks  on  the  sched 
ule.  Ihere  is  a training  and  familiar 
ization  time  required  to  accomplish 
the  task  correctly  if  a new  person  is 
assigned  to  a new  task.  It  is  also 
ofte(r  more  difficult  for  several  in- 
dividuals to  perform  the  same  func- 
tion on  the  same  task  simultaneously. 
Because  of  the  intercommunication  re- 
quirements, three  people  cannot  ac- 
complish a task  in  one-third  of  the 
time  required  for  one  person.  Another 
effect  of  limited  personnel  is  that 
when  one  programmer  is  delayed  on  a 
task,  the  successive  tasks  for  which 
he  has  been  scheduled  will  be  delayed, 
possibly  affecting  the  overall  project 
schedule.  This  effect  is  not  directly 
visible  from  the  schedule  of  tasks 
only. 

The  computer  time  resource  can 
seriously  affect  a project  schedule. 

If  the  computer  becomes  overburdened, 
the  turnaround  time  is  adversely 
affected  which  can  lead  to  delays  in 
task  completions.  All  of  the  computer 
resources  must  be  accounted  for  in  the 
scheduling  including  terminals  and 
keypunching  facilities  because  any  in- 
adequate resources  can  produce  a de- 
lay. In  systems  such  as  simulators, 
in  addition  to  program  development. 
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Figure  1.  Software  Network 


the  computer  test-heit  time  to  inte- 
grate the  software  and  hardware  is 
extremely  important  in  scheduling. 
Projects  have  reached  the  final  stages 
before  it  was  discovered  that  48  hours 
of  computer  time  was  required  per  day 
to  complete  the  project  as  scheduled. 
This  led  to  serious  delays  from  which 
there  was  no  possible  recovery.  It  is, 
therefore,  necessary  to  ensure  that  the 
tasf  schedule  does  not  cause  an  over- 
run of  the  available  computer  resour- 
les.  Thus,  the  scheduling  technic) ue 
must  initially  account  tor  ttie  utili- 
sation of  resources  and  their  inter- 
actions with  the  tasis. 

SCHLDUL 1 NG 

Having  networked  the  tasks,  we  art- 
ready  to  generate  the  schedules  for 
the  project.  The  task  time  estimates 
are  added  to  the  network  and  the  path 
times  are  computed.  These  estimating 
times  should  be  in  whole  units  of  days 
or  weeks  as  smaller  units  are  not  sig- 
nificant for  large  software  projects. 
The  estin.ated  task  duration  times  are 
used  to  compute  start  and  end  times 
♦or  each  task,  and  from  that,  the 
float  times  of  each  one.  The  path 
with  ^ero  float  time  is  the  critical 
path  and  the  length  of  this  path  is 
the  minimur.  time  to  complete  the  pro- 
ject. The  criti'al  path  is  compared 
with  the  required  completion  time  of 
the  project.  If  a conflict  exists 
with  the  time  required  being  greater 
than  allowed,  it  must  be  resolved  at 
this  time.  tither  the  project  com- 
pletion tiit'e  must  be  increased  or  the 
network  plan  must  be  modified.  After 
this  v-onflict  is  resolved,  the  re- 
sources schedules  can  be  generated. 

The  personnel  resources  schedule  lon- 
sists  of  a series  of  Gantt  charts  or 
a table  of  times  indicating  each  per- 
son, their  assigned  tasks,  and  the 
times  during  which  they  are  working  on 
these  tasks.  This  information  can 
then  be  fed  back  into  the  network  to 
schedule  the  tasks  and  float  times  on 
the  noncritical  paths.  The  utilisa- 
tion of  specific  personnel  for  selec- 
ted tasks  may  affect  the  overall  task 
schedule.  Indications  of  this  effect 
should  be  entered  on  the  network  in 
the  form  of  dashed  lines  with  appro- 
priate labels  indicating  that  certain 
tasks  cannot  begin  until  the  personnel 
have  completed  other  tasks  and  are 
available.  This  additional  informa- 
tion may  aid  in  the  quick  assessment 
of  the  effects  of  possible  changes  to 
the  schedule.  The  effects  of  person- 
nel scheduling  may  even  change  the 
critical  path  of  the  project. 


This  phase  of  the  process  may  re- 
veal that  more  personnel  are  required 
during  certain  periods  or  that  some 
personnel  have  periods  with  no  desig- 
nate cj  task’.  If  it  i ■,  found  that  t h e s 
schedules  are  incompatible,  then  ad- 
justments must  be  made  either  ir  the 
task  personnel  assignments  or  the  ta'.k 
network.  Several  iterations  of  adju't 
ments  to  the  network  and  personnel 
schedules  may  be  required  to  obtain 
the  desired  schedules.  figure  2 pre- 
sents a sample  personnel  .chedule. 

lince  the  task  ind  personnel 
schedules  have  been  satisfied,  the 
computer  resource,  sihedule  can  be 
generated.  This  operation  can  be  per- 
formed simultaneously  with  the  person- 
nel schedule,  but  it  becomes  more  com- 
plicated if  done  manually.  This  sched 
ule  will  indicate  computer  resource 
requirements  by  task  on  a weekly  basis 
This  schedule  must  account  for  the 
type  of  system  to  be  used.  for  ex- 
ample, if  on-line  terminals  are  to  be 
used,  the  terminal  usage  times  must  be 
evaluated  in  addition  to  total  com- 
puter time.  Based  on  these  inputs, 
the  total  computer  resources  can  be 
computed  for  each  week.  This  schedule 
can  then  be  evaluated  to  determine  if 
there  are  sufficient  terminals  avail- 
able, or  how  many  shifts  the  compcjter 
:nust  be  run  and  if  there  is  sufficient 
computer  power  available.  If  the 
schedule  shows  a requirement  for  more 
than  168  hours  of  computer  usage  per 
week  for  the  last  few  weeks,  then 
either  a second  computer  is  required 
or  the  schedule  requires  adjusfsent. 
Failure  to  plan  for  computer  resources 
has  been  the  downfall  of  many  projects 
Suddenly  at  the  end  of  the  project, 
everyone  wants  computer  tinie  and  there 
isn't  sufficient  time  available.  The 
project  which  was  on  schedule  is  sud- 
denly delayed  significantly  just  be- 
fore completion.  This  traqii  happen- 
ing I an  be  avoided  through  proper  plan 
ninq  "f  resources  at  the  beginning  of 
the  project.  Figure  3 presents  a sam- 
tle  computer  resources  schedule. 

This  scheduling  process  can 
be  automated  by  using  a computer 
program.  The  program  can  compute 
the  critical  patti  and  verify  that 
the  resources  are  utilized  effec- 
tively. The  task  assignment  and 
network  plan  must,  however,  be 
performed  manually  because  of  the 
subjective  nature  of  the  decisions. 

The  program  cannot  know  task  inter- 
relationships and  which  person  can 
effectively  perform  which  tasks;  and 
random  task  assignment  is  not  advised 
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Figure  2.  Personnel  Resources  Scheoule 
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h p c a u s all  p e r s 0 n tip  1 a f p not  p q u <i  1 t n 
ability  and  expcripni.p. 

The  n »?  t »■  0 1- 1>  s c h p d u 1 p can  be 
ea'.  ily  oriented  toward  calendar  time. 
Ibis  revised  $ c b e d u 1 e can  account  for 
vacation,  holiday^  and  weeiend  times 
and  provide  t a ► lompletion  calendar 
dates.  After  the  iriitial  scheiiule  has 
been  tjenerated,  the  •_  alendar  start 
date  and  time  off  days  tan  be  factored 
in  result  irvg  in  a calendar  oriented 
schedule  sji.h  as  in  figure  4.  This 
information  can  tie  entered  into  the 
netwiiri  chart  resulting  in  a chart  as 
p r i‘  s e n ■ e d in  Figure  5 . 

■ r.  a lar  jf*  project,  there  may  be 
s e V e r I 1 levels  of  managers  for  the 
sot ‘wart*  p'oject.  These  individuals 
navi'  dif'erent  levels  of  interest  in 
the  pri'jress  0^  the  project.  There- 
fore, different  levels  of  the  task 

n e t w 0 r K can  be  generated  corresponding 
to  the  top-down  nierartfiy  of  tasks. 
This  cap.ibility  provides  each  manager 
with  a reasonable  schedule  <or  moni- 
tor inn  project  progress  without  un- 
neci",  >,  aiy  details,  ap;ili  cable  only  to 
f'l'  lower  level  manager. 


PPjjGRL  b ."'O.’-I  TpRjL'iG 

'rh'.  e the  task  network  and  re- 
sources schedules  have  been  completed, 
they  call  be  used  to  monitor  the  pro- 
gres  . i,f  the  p'  .ject.  It  is  important 
to  reie'slMi  that  the  plan  and  sched- 
ules jri  based  oh  estiniates.  I he 
schedule  serve-,  as  a guide  but  is  not 
perfect.  As  the  p r o j e i t proceeds, 

' h a r,  'j  e s ay  be  required  in  the  s c h e d - 
I e and  plan.  Thereiore,  they  must  be 
f 1 e / i b 1 e , and  it  must  be  possible  to 
i ii'P  1 e-ip  n t Changes.  Very  snail  devia- 
tions "ay  be  ig’o.ri'd  becaus*-  fiie  ef- 
fort involved  i ri  documenting  the  sched- 
ule ohange  i'  significant.  A task 
whii.n  deviafps  'roas  sctieluli-  by  one 
wei-k  out  of  10  or  . ij  sfiould  not  cause 
a schedule  update  as  the  estimate  may 
!' e of*  by  ‘j  or  10  w »■  i c h could  nullify 
the  Jeviafion.  S'*  course,  the  deci- 
sion to  regerierate  the  s-hedule  is 
Subjective  and  no  hard  -ind  fast  rule 
sari  Pe  'ade.  "^ajor  ehariges  .iffectiri'i 
schedule  riu'.  r lead  t'r  a resi,  hedule  pro- 
cess. If  the  sf>jrigi*s  affect  the  n;- 
source  e . ' ' r' a t e , new  estiriafes  must 
be  generated  and  u-.ed  to  update  sched- 
ules. the  tasv  nefwrk,  pets  urine  1 and 
■omputer  resources  schedules  must  all 
i.e  updated  itid  verified  for  compati- 
bility. The  srhedules  can  tfien  be 
used  by  manageni'hf  to  track  the  pro- 
ject progress.  when  significant 


deviations  occur,  management  can 
quickly  react  to  accommodate  the 
changes.  As  long  as  no  significant 
schedule  deviations  exist,  management 
can  devote  its  ener'jies  tn  other  pro- 
jects which  require  assistance.  This 
manaqement-by-exception  is  highly  de- 
pendent upon  the  belief  that  the 
schedule  is  accurate  and  that  the  re- 
porting of  progress  is  true. 

Progress  reporting  should  be 
highly  objective  and  not  subjective. 
Although  the  project  is  activity  ori- 
ented, each  activity  must  be  clearly 
defined  so  that  it  can  be  easily  seer, 
when  it  begins  and  ends.  This  is 
essential  so  that  progress  reports  do 
not  indicate  90t  completion  for  60; 
of  the  time.  The  person  reporting  the 
status  must  be  able  to  produce  visible 
evidence  of  task  completion  such  as  a 
listing  or  document  which  can  be 
easily  evaluated.  The  lowest  level 
tasks  are  considered  to  be  zero  per- 
cent complete  until  they  are  100'  com- 
pleted. This  policy  avoids  subjective 
and  often  meaningless  s t a t us‘  repor t s . 
The  short  duration  of  these  tasks  ar- 
complished  through  the  heirarchical 
decomposition  makes  this  method  of 
status  reporting  possible. 

Accurate  records  of  the  progress 
and  exact  resource  expenditures  stiould 
be  maintained.  The  data  collection  of 
actual  personnel  and  computer  resource 
experiditures  can  be  part  of  the  pro- 
gress monitoring  activity.  If  a re- 
scheduling occurs,  the  old  schedule 
should  he  filed  and  not  d i s c a r d i? d . 
when  the  project  is  complete,  this 
data  base  can  tnen  be  used  tor  eval- 
uating the  overall  project  accomplish- 
ments and  for  future  estimating  and 
planning  activities.  w'  h e t h e r t h ('  pro- 
ject follows  the  original  schedule  or 
not,  the  collection  of  thi-,  data  is 
very  useful  for  future  lefereiiLe. 


CONCLUSION 

A large  '.oftware  project  is  a 
very  complex  task.  The  problems  of 
managing  such  a project  can  be  greatly 
reduced  through  proper  planning  ind 
scheduling  of  the  tasks,  personnel  and 
computei'  resources.  One  of  the  keys 
to  successful  scheduling  is  to  con- 
sider all  of  these  items  simultaneous- 
ly to  account  for  their  i ri t e r a i t i o n s , 
and  the  1 n t {>  r d e |i  c n d e n c i e s o t the  var- 
ious s 0 f t w .1  r e tasks.  Using  a network 
toi  ta'.k  planning  and  scheduling, 

Gantt  charts  for  personnel  resources 
and  a table  of  computer  resources 
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utili/dtion,  the  problem  can  be 
ha ri died  in  an  effective  manner. 
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THE  EFFlCIFNCy  OF  FORTRAN  IN  SIMULATION  COMPUTERS 
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Akron,  Ohio 


INTRODUCTION 


The  task  of  initially  selecting 
and  sizing  computer  systems  for  train- 
ing simulators  is  becoming  more  diffi- 
cult. Current  Air  Force  and  Navy  sim- 
ulator specifications  state  that  the 
software  shall  be  programmed  in 
FORTRAN  to  the  maximum  degree  techni- 
cally feasible.  Although  the  use  of 
a higher  level  language  such  as 
FORTRAN  is  desirable  in  many  respects 
for  both  simulator  user  and  contrac- 
tor, it  entails  an  extensive  new  ef- 
fort for  the  contractor  during  com- 
puter selection  and  sizing.  Previous- 
ly, software  for  simulators  was  pro- 
grammed in  assembly  language.  A 
thorough  understanding  of  the  adverse 
impact  of  FORTRAN  on  computer  loading 
is  necessary  to  reduce  the  risk  in- 
volved with  computer  selection. 

COMPUTER  SELECTION  CONSIDERATIONS 

The  various  types  of  computers 
and  the  size  of  their  associated 
operational  programs  for  a number  of 
Air  Force  simulators  are  shown  in 
Table  1 which  was  extracted  from 
Reference  1.  Twelve  different  types 
of  computers  are  used  in  the  twenty- 
one  simulators  Identified.  From  one  to 
four  coniputers  are  used  per  simulator. 
The  size  of  these  computer  systems  as 
indicated  by  words  of  core  in  the  table 
varies  from  30K  to  194K  (where  K=1000). 
In  summary,  there  is  a wide  variation 
in  the  type  and  size  of  computer  sys- 
tems used  in  simulators. 

Selection  of  a computer  system 
must  include  an  assessment  of  per- 
formance as  well  as  factors  such  as 
cost,  reliability,  maintainability, 
configuration  control,  data  and  avail- 
ability of  equipment.  A discussion 
of  computer  performance  follows. 

To  select  a computer  system  for 
a simulator  application,  the  process- 
ing requirements  must  be  determined 
from  the  amount  and  fidelity  of  the 
simulation  required.  All  data  trans- 
fers must  be  analyzed  to  determine  the 
proper  type  and  speed  for  each  inter- 
face. Simulator  computers  are 


typically  compute  limited,  not  input/ 
output  1 imi ted  . 

In  the  past  when  simulator  soft- 
ware was  programmed  in  assembly  lan- 
guage, a computer  loading  estimate  was 
developed  using  the  instruction  set  of 
the  candidate  computer.  This  estimate 
determined  the  approximate  number  of 
computer  memory  words  required  and  was 
subdivided  into  instructions  and  date. 
From  the  estimated  number  of  instruc- 
tions and  instruction  execution  times, 
the  time  required  to  perform  all  com- 
putations and  input/output  was  esti- 
mated. The  computer  system  was  then 
sized  as  far  as  memory  and  central 
processing  units  are  concerned.  For 
present  simulator  procurements,  this 
method  is  no  longer  adequate  because 
it  does  not  consider  the  effect  of 
FORTRAN  on  the  computer  loading  esti- 
mate. This  paper  will  discuss  and 
measure  several  aspects  of  that  effect 

For  a real-time  application,  it 
is  necessary  to  determine  whether  the 
computer  system  being  considered  is 
sufficiently  fast  to  perform  all  com- 
putations and  input/output  and  whether 
the  resultant  computer  loading  is  with 
in  the  real-time  constraint  of  the 
system.  For  digital  flight  simulators 
the  real-time  constraint  is  a strin- 
gent one  where  solution  rates  of  up  to 
60  times  per  second  may  be  required. 

Resolution  and  accuracy  require- 
ments also  are  considered  before  a 
computer  system  is  selected.  These 
requirements  are  analyzed  for  both 
computations  and  input/output  opera- 
tions to  determine  if  the  word  length 
of  the  considered  computer  is  ade- 
quate. 

Optional  features  of  the  con- 
sidered computer  also  must  be  evalu- 
ated, such  as  additioOu*  hardware  in- 
terrupts or  other  pro  > or  options. 
Throughout  a computer  .ystem  analy- 
sis, the  cost  and  cost  effectiveness 
of  various  components  and  features  are 
considered  . 


TABLE  1.  COMPUTATION  SYSTEMS  COMPENDIUM* 


TRAINING  DEVICE 
C- 1 35B 
C-HIA 
C-1 41A 
F-4E 
C-5A 
F-n  lA 

FB-lllA  (BOMB/NAV) 

FB-1  1 lA 

A-7D 

HH-S3C 

CH-3 

F- 1 no 
F-n  IF 
F-15 
T-37 
T-38 

B-52  (MOD) 

SEWT  (SIMULATOR  FOR 
ELECTRONIC  WARFARE) 

ASUPT  (ADVANCED 
SIMULATOR  FOR  UNDER- 
GRADUATE PILOT 
TRAINING) 

SAAC  (SIMULATOR  FOR 
AIR-TO-AIR  COMBAT) 

UNTS  (UNDERGRADUATE 
NAVIGATION  TRAINING 
SIMULATOR) 


LENGTH  OF  THE  OPERATIONAL 
COMPUTERS/  COMPUTER  PROGRAM  SYSTEM 

COM PJJIR  SIMULATOR  (WORDS  OF  CORE) 


MARK  I 
CDC  921 
SEL  840A 
GP4B  (SINGER) 
SEL  840A/840MP 
GP4 

SIGMA  5 
SIGMA  5 
DC  6024/1 
DC  6024/3 
DC  6024/3 
GP4B 
GP4B 

DC  6024/4 
DC  6024/4 
DC  6024/4 
DC  6024/5 
SEL  86 

SEL  86 

SIGMA  5 

HONEYWELL  H 716 


1 

2 

1 

1 

2 

1 

2 

3 

1 

1 

1 

2 

2 

2 

3/4  COCKPITS 
3/4  COCKPITS 
1 
1 

3 

4 

41/52  STATIONS 


NOT  AVAILABLE 
38K 
34K 
92K 
63K 
92K 
88K 
180K 
40K 
30K 
30K 
1 94K 
1 75K 
1 03K 
42K 
4 9K 
30K 
50K 

FLIGHT  83K 
VISUAL  32K 
( FORTRAN  ) 


80-100K 

(FORTRAN) 

COMPLEX  51K  13  EA 
RADAR  CONTROL 
9K  (1  TIME) 


•THE  DATA  IN  THIS  TABLE  WAS  EXTRACTED  FROM  AIR  FORCE  MASTER  PLAN 
SIMULATORS  FOR  AIRCREW  TRAINING.  FINAL  REPORT.  DECEMBER  1975 
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Since  d redl-time  system  often 
must  he  chdn()e<l  to  meet  ddditional  re- 
guicements,  system  expdnsion  cdpdbili- 
ttes  dre  dndiyzed.  The  system  should 
be  ; d p d h 1 e of  e * p d n d i n g in  d m o d u 1 d r 
m d n n e r w i t ii  v i r t u d 1 1 y no  d i s t u r b d n c e 
to  current  o p e r d t i o n s . 

I F 1 C,A  N T COMF’  U T L H PJJ  f OJTMA  NO, 

C_HA R A CT f_R  1 S T I C S 

for  simuldtors  currently  being 
specified,  performdfice  chdrdcteris- 
tics  of  1)  red  test  significdnce  dre: 

Speed 

FORTRAN  efficiency 
Multiprocessor  cdpdbil'ty 
Increased  addressing  capability 

Speed,  in  terms  of  IPS  (instructions 
per  second),  has  always  been  and  con- 
tinues to  be  of  primary  importance  in 
simulator  computer  selection.  FORTRAN 
efficiency,  which  is  the  subject  of 
this  paper,  has  become  a critical 
Item  because  of  the  requirement  to  use 
FORTRAN  as  the  primary  programming 
language.  Multiprocessor  capability 
and  direct  addressing  of  increasingly 
larger  blocFs  of  memory  have  become 
significant  items  because  of  increas- 
ing simulation  requirements  and  com- 
puter spare  time  and  memory  require- 
ments of  up  to  40  . 

FORTRAN  VS.  ASSLMBLY  LANGUAGE 
EJf  UiencT 

A study  was  formulated  in  order 
to  evaluate  the  various  coding  types 
that  exist  in  a simulator  and  deter- 
mine which  types  could  be  efficiently 
programmed  in  FORTRAN.  Siniulation 
programs  written  in  Harris  SLASH  4 
assembly  language  from  the  F-IS  Flight 
Simulator  developed  by  Goodyear  Aero- 
space were  used  as  the  input  for  this 
study . 

A computer  program  was  developed 
to  read  Harris  assembly  language 
source  code,  classify  the  code  into 
various  types  and  print  the  code  type 
distribution  data. 

This  data  was  examined  to  deter- 
mine which  coding  types  should  be 
studied  in  detail.  The  criteria  for 
selection  included  a significant 
amount  of  use  in  several  programs  and 
a type  which  could  be  isolated  for 
study.  Tfie  selected  coding  types  were 
then  evaluated  for  the  effects  of  the 
FORTRAN  compiler  on  the  size  and 


running  time  of  the  code.  The  areas 
selected  for  study  were  bit  manipula- 
tions, logical  operations,  floating 
point  arithmetic  and  basic  instruc- 
tions. These  types  of  processing  were 
studied  by  comparing  abbreviated 
FORTRAN  and  assembly  versions  of  F-IG 
simulator  programs. 

The  Harris  FORTRAN  compiler  had 
as  an  optional  feature  an  optimizer 
which  processed  the  FORTRAN  output  and 
produced  more  efficient  code  in  sever- 
al areas.  Quantitative  results  of  op- 
timized FORTRAN  vs  assembly  language 
efficiency  for  the  various  processing 
types  are  shown  in  Table  2.  A discus- 
sion of  each  type  of  processing  fol- 
lows. 

8J  T OPERATIONS 

Bit  operations  are  defined  as 
those  which  manipulate  a single  bit 
either  via  a register  or  directly  in 
memory.  It  was  theorized  that  these 
would  provide  severe  difficulty  for 
FORTRAN  to  handle  efficiently  because 
there  is  no  direct  reference  to  indi- 
vidual bits  in  FORTRAN.  The  HUD  con- 
trol (HUDCTL)  program  was  selected 
for  the  test.  Portions  of  HUDCTL  were 
extracted  and  coded  in  FORTRAN  and 
assembly  language.  These  portions 
were  considered  to  be  representative 
of  simulator  bit  processing.  There 
were  two  FORTRAN  versions  generated. 

One  version  used  a larger  data  matrix 
with  one  word  representing  each  pos- 
sible discrete  signal. 

Four  runs  were  made  through  dif- 
ferent paths  of  the  program  logic. 

This  was  done  to  ensure  that  several 
code  variations  were  exercised  for  a 
larger  data  sample.  The  results  in 
Table  2 were  based  on  the  average  exe- 
cution time  for  these  four  runs.  It 
was  concluded  that,  for  the  Harris 
SLASH  4,  FORTRAN  cannot  efficiently 
handle  bit  manipulations.  This  com- 
puter is  designed  to  efficiently  ma- 
nipulate single  bits  and  is  more  effi- 
cient than  some  other  computers  in 
this  respect.  However,  the  FORTRAN 
compiler  is  not  designed  for  bit  iiianip- 
ulation  and,  tfierefore,  does  not  take 
advantage  of  the  machine  capability. 

Nor  does  the  optimizer  significantly 
improve  the  results  for  this  type  of 
processing.  The  use  of  one  word  per 
signal  instead  of  a packed  format  im- 
proved the  program  time  and  core  effi- 
ciency but  required  a much  larger  core 
area  for  the  data.  In  this  example, 
it  was  assumed  that  the  20  data  words 
were  fully  packed  with  24  discretes 
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TABLt  2.  OPTIMIZFn  FORTRAN  VS  ASSEMBLY  LANGUAGE  EFFICIENCY, 
HARRIS  FORTRAN 

SIZE  OF  ASSEMBLY  % SIZE  EXPANSION  I TIME  EXPANSION 

TYPE  OF  PROCESSING  SAMPLE  (WORDS)  OVER  ASSEMBLY  LANGUAGE  OVER  ASSEMBLY  LANGUAGE 


BIT  (PACKED  DATA) 

97 

186 

185 

BIT  (UNPACKED  DATA) 

51 

41 

33 

BASIC  (TRANSFER. 

ADD,  SUBTRACT,  COM- 
PARE, BRANCH) 

178 

1 1 

10 

FLOATING  POINT 

445 

12 

14 

LOGICAL 

106 

5 

7 

AVERAGE  OF  ABOVE 
(EXCLUSIVE  OF  BIT, 
PACKED  DATA) 

1 7 

16 
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in  each.  Ihe  word  version,  therefore, 
required  4H0  words  for  data  instead  of 
20.  This  method,  though  much  better 
than  the  packed  format  method,  is 
still  not  efficient  enough  for  a bit 
manipulating  program.  An  alternative 
to  the  use  of  FORTRAN  would  be  to  code 
programs  with  a large  amount  of  bit 
manipulation  instructions  in  assembly 
lancjuage  or  to  use  in-line  assembly 
language  code  for  this  type  of  pro- 
cessing. If  this  is  not  possible,  and 
timing  is  a critical  factor,  the  use 
of  one  signal  per  word  is  another  pos- 
sible alternative  if  sufficient  core 
is  available. 

No  FORTRAN  compilers  of  the  can- 
didate computers  for  simulators  have 
the  capability  to  handle  individual 
bits  efficiently.  Some  of  these  com- 
puters also  lack  the  capability  to 
handle  bits  efficiently  even  in  assem- 
bly language  because  of  different  ma- 
chine architecture.  For  these  com- 
puters, the  difference  between  assem- 
bly language  and  FORTRAN  may  not  be  as 
great. 

L_0G  ICAL  OPERATIONS 

Logical  operations  are  defined  as 
the  AND,  OR  and  XOR  functions.  It  was 
theorized  that  the  Harris  SLASH  4 
FORTRAN  could  efficiently  handle  a 
program  of  ttiis  type  which  masks  and 
manipulates  several  bits  at  one  time. 
The  Built-In-Test  (BIT)  program  was 
selected  as  representative  of  signi- 
ficant use  of  this  kind  of  code.  Se- 
lected portions  of  BIT  were  coded  both 
in  FORTRAN  and  assembly  language. 

Si*  runs  were  made  to  exercise 
various  program  paths  and  ensure  that 
coding  was  identical  in  both  the  as- 
sembly and  FORTRAN  versions.  The  re- 
sults indicate  that  with  optimization, 
FORTRAN  is  almost  as  efficient  as  as- 
sembly language.  This  indicates  that 
programs  with  logical  operations  could 
be  coded  in  FORTRAN  for  the  Harris 
MASH  4 computer.  Some  other  computer 
systems,  however,  do  not  have  the  AND, 
OR,  and  XOR  operators  available  for 
masking  operations  except  as  intrinsic 
functions.  If  these  compilers  are 
used,  and  (jenerate  function  calls  in- 
stead of  simple  instructions,  the  ef- 
ficiency will  be  greatly  reduced.  For 
these  systems,  their  standard  FORTRAN 
nay  be  adequate  for  logic  functions. 

If  these  compilers  generate  direct 
code  as  efficiently  as  the  Harris  com- 
piler instead  of  function  calls,  they 
would  be  adequate. 


floating  POINT 

Floating  point  arithmetic  opera- 
tions comprise  a major  portion  of  sim- 
ulator programs  and,  thus,  it  is  impor- 
tant that  FORTRAN  efficiently  compile 
it.  The  Forces  and  Moments  (FCMOM) 
program  has  many  floating  point  equa- 
tions and  had  previously  been  compiled 
by  the  Harris  optimizing  compiler. 

The  generated  code  was  studied  for  its 
efficiency.  It  was  found  to  be  very 
efficient,  as  expected.  There  is  no 
problem  in  using  FORTRAN  for  floating 
point  equations.  Since  FCMOM  is  90% 
floating  point  operations,  it  is  a 
good  benchmark  for  assessing  FORTRAN 
floating  point  efficiency.  The  FCMOM 
program  will  be  discussed  in  more  de- 
tail in  the  benchmark  section  of  this 
paper. 

BASIC  INSTRUCTIONS 

The  category  of  basic  instruc- 
tions includes  integer  arithmetic, 
transfers,  compares,  branches.  A 
benchmark  containing  these  instruc- 
tion types  was  generated  from  the 
Tactics  Data  Save  (TACSAV)  program. 

It  was  anticipated  the  FORTRAN  opti- 
mizing compiler  would  handle  these 
types  of  instructions  very  efficiently 
The  benchmark  results,  presented  in 
Table  2 indicate  this  is  true.  Pro- 
grams composed  primarily  of  these 
basic  instructions  could,  therefore, 
be  efficiently  programmed  in  FORTRAN. 

OTHER  INSTRUCTION  TYPES 

Shift  instructions  were  found  to 
be  a small  percentage  of  F-15  simula- 
tor instructions  and,  therefore,  con- 
sidered to  be  insignificant.  The 
Harris  compiler  has  special  instruc- 
tions (SHIFT  and  ROTAT)  which  enable 
efficient  shift  operations.  Other 
compilers  rely  on  the  optimizer  to 
translate  a power  of  2 into  a shift 
operation.  This  also  provides  effi- 
cient coding  except  in  the  case  when 
end  around  shifting  is  desired.  This 
operation,  though  not  handled  direct- 
ly by  many  compilers,  is  not  critical 
to  simulator  programs.  Thus,  there 
appears  to  be  no  problem  with  most 
Shift  instructions  being  handled  by 
FORTRAN . 

Byte  instructions  were  also  found 
to  be  a small  percentage  of  F-15  sim- 
ulator instructions.  Since  these  in- 
structions really  are  designed  to  han- 
dle the  lower  8 bits  of  a word  in  the 
accumulator,  it  appears  that  there 
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will  be  no  significant  change  in  effi- 
ciency in  using  FORTRAN  for  programs 
which  contain  these  instructions. 

I 

Input/output  and  interrupt  han- 
dling functions  are  very  ill-suited 
to  FORTRAN.  It  is,  ttierefore,  necessary 
that  routines  with  these  instructions 
be  written  in  assembly  language  or  in 
FORTRAN  with  some  in-line  assembly 
code  in  special  areas.  FORTRAN,  un- 
like assembly  language,  does  not  pro- 
vide a direct  input/output  capability. 
The  calling  of  general-purpose  I/O 
subroutines  by  FORTRAN  in  lieu  of  dir- 
ect input/output  is  unacceptable  be- 
cause of  their  inherent  inefficiency. 
There  is  no  capability  in  FORTRAN  to 
save  registers  as  is  required  for  an 
interrupt  routine.  Therefore,  simula- 
tor programs  which  contain  I/O  func- 
tions or  which  are  interrupt  initiated 
cannot  be  coded  in  FORTRAN. 

FORTRAN  VS.  ASSEMBLY  LANGUAGE 
EFFICIENCY  - CONCLUSIONS 

The  operations  of  programs  were 
divided  into  coding  types,  and  these 
types  were  evaluated  for  their  use  in 
FORTRAN.  The  following  types  were 
found  to  be  inadequate  for  FORTRAN: 

\ single  bit  manipulation,  i npu t/ou tpu t , 

and  interrupt  processing.  The  pro- 
cessing types  which  are  amenable  to 
FORTRAN  are  floating  point  arithmetic, 
logical  functions,  and  basic  instruc- 
tions which  include  transfers,  inte- 
ger arithmetic,  branches,  compares, 
shifts  and  byte  operations. 

OPTIMIZATION  CONSIDERATIONS 

As  mentioned  earlier,  the  Harris 
FORTRAN  compiler  features  an  optimizer 
which  processes  the  FORTRAN  output  and 
produces  more  efficient  object  code  in 
several  areas.  This  optimization  is 
all  local;  that  is,  each  statement  is 
optimized  independently  of  other  state- 

) ments.  The  result  of  this  optimiza- 

tion is  a reduction  in  module  storage 
and  execution  time  requirements.  The 
actual  reductions  are  dependent  upon 
the  amount  of  code  in  those  areas  that 
the  optimizer  operates  on.  According 
to  Reference  2,  for  a typical  module 
the  number  of  memory  words  required  to 
store  the  program  exclusive  of  data 
words  is  reduced  by  10  to  b0%.  The 
computation  time  exclusive  of  input/ 
output  time  is  reduced  by  10  to  30t. 

This  is  corroborated  by  the  actual  re- 
sults for  the  types  of  processing 
discussed  above.  These  results  in 
terms  of  percent  expansion  before  and 


after  optimization,  are  shown  in  Table 
3.  The  average  core  savings  exclusive 
of  data  for  all  five  processing  types 
in  the  Table  was  43%.  The  average 
execution  time  savings  was  29%.  These 
savings  are  significant  enough  to  dem- 
onstrate the  importance  of  using  an 
optimizing  FORTRAN  compiler  in  real- 
time training  simulators. 

Therefore,  any  computer  selected 
for  use  in  a training  simulator  whicli 
will  be  programmed  in  FORTRAN  should 
have  an  optimizing  compiler.  The 
Harris  optimizer  is  efficient  enough 
to  make  the  use  of  FORTRAN  possible  in 
simulators.  The  optimizer  does  not 
enable  the  efficient  use  of  bit  manip- 
ulation, I/O  and  interrupts.  These 
instruction  types  would  have  to  be 
coded  in  assembly  language  to  maintain 
high  program  efficiency.  Other  com- 
puters which  could  be  selected  for 
simulation  must  have  a FORTRAN  opti- 
mizer at  least  as  efficient  as  the 
Harris  optimizer.  Some  of  these  sys- 
tems have  global  optimizers,  which 
optimize  code  across  more  than  one 
statement  at  a time,  thus  providing 
increased  efficiency. 

A comparison  of  two  optimizing 
compilers  that  are  designed  for  exe- 
cution on  the  same  computer,  the 
Interdata  8/32,  is  shown  in  Table  4. 
FORTRAN  VI,  which  is  a superset  of  the 
ANSI  Standard  (X3. 9-  1 966  ),  performs 
optimizations  which  include  subscript 
evaluation  by  linearization,  common 
index  elimination,  register  alloca- 
tion and  transfer  logic.  FORTRAN  VII 
which  is  being  implemented  according 
to  one  of  the  latest  ANSI  Standards 
(X3J3/56),  performs  more  extensive 
optimizations  including  both  machine 
independent  and  machine  dependent  op- 
timizations. Table  4 shows  results 
for  the  combined  totals  of  the  FCMOM 
and  ELECT  benchmark  programs  which  are 
discussed  in  the  fol1owin()  section  of 
this  paper.  The  FORTRAN  VII  compiler 
was  not  available  for  an  actual  bench- 
mark run  because  the  compiler  was 
undergoing  final  acceptance  test. 
However,  projected  results  were  ob- 
tained by  ha nd -op t i m i z i ng  the  code 
generated  by  the  FORTRAN  VI  compiler 
according  to  the  design  specification 
of  the  FORTRAN  VII  compiler.  From  the 
table,  it  can  be  seen  that  a 32% 
savings  in  memory  and  a 231  savings  in 
time  are  achieved  with  the  compiler 
with  more  extensive  optimization. 
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TABLE  3.  BEFORE  AND  AFTER  OPTIMIZATION,  HARRIS  FORTRAN 


k 


TYPE  OF  PROCESSING 

% SIZE  EXPANSION 

OVER  ASSEMBLY  LANGUAGE 

% TIME  EXPANSION 

OVER  ASSEMBLY  LANGUAGE 

BEFORE 

AFTER 

BEFORE 

AFTER 

BIT  (PACKED  DATA) 

208 

186 

189 

185 

BIT  (UNPACKED  DATA) 

90 

41 

48 

33 

LOGICAL 

31 

5 

24 

7 

FLOATING  POINT 

22 

1 2 

25 

14 

BASIC 

93 

1 1 

62 

10 

AVERAGE  CORE 
(OPTIMIZED  VS 
OPTIMIZED) 

43% 

SAVINGS 

NON- 

AVERAGE  TIME 
(OPTIMIZED  VS 
OPTIMIZED) 

29% 

SAVINGS 

NON- 

TABLE  A.  A COMPARISON  OF  TWO  OPTIMIZING  COMPILERS 

COMBINED  TOTALS  OF  INTERDATA  8/32 

FCMOM  AND  ELECT 


BENCHMARKS  

FORlRA_N..yi 

FORTRAN  ' 

MEMORY  TOTAL  (WORDS) 

1277 

867 

% MEMORY  SAVINGS 

- 

32 

TIME  TOTAL  (MSEC) 

1620 

1250 

% TIME  SAVINGS 

- 

23 

♦PROJECTED  RESULTS 
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BENCHMARK  PROGRAMS 


Two  FORTRAN  benchmark  programs 
were  used  to  measure  the  relative  per- 
formance capabilities  of  potential 
simulation  computers  and  their  FORTRAN 
compilers.  The  benchmark  programs 
were  run  on  each  computer.  These  pro- 
grams are  representative  samples  of 
the  kinds  of  programs  that  are  used  in 
flight  simulators.  Two  performance 
criteria  were  considered:  (1)  com- 
piled program  size  and  (2)  program 
execution  time.  The  characteristics 
of  tiie  tested  programs  on  the  detailed 
test  results  are  presented  below. 

The  two  programs  which  were  used 
are  FORTRAN  versions  of  assembly  lan- 
guage programs  selected  from  the  F-15 
flight  simulator.  One  program,  which 
is  part  of  the  aerodynamics  simulation 
subsystem,  evaluates  total  aircraft 
forces  and  mooients.  The  other  program 
simulates  one  of  the  aircraft  systems, 
the  electrical  system. 

The  Forces  and  Moments  Program 
(FCMOM)  consists  almost  entirely  of 
a r i t hme t i c- ty pe  expressions.  The  num- 
ber of  executable  source  statements  in 
the  FORTRAN  program  is  83  as  compared 
with  372  in  the  F-15  assembly  language 
program.  Both  of  these  numbers  are 
program  size  only  and  as  such  do  not 
include  storage  of  external  variables. 
The  test  case  that  was  selected  cor- 
responded to  an  airborne  F-15  in  a 
typical  flight  configuration. 

The  Electrical  Program  (ELECT) 
consists  almost  entirely  of  logical 
expressions.  There  are  277  execut- 
able source  statements  in  the  FORTRAN 
program  as  compared  with  324  in  the 
F-15  assembly  language  program.  Four 
test  cases  were  selected  which  corres- 
pond to  typical  operational  conditions 
of  the  electrical  system.  An  assump- 
tion that  was  made  prior  to  coding  the 
ELECT  program  was  that  each  discrete 
input  and  output  resided  in  a full 
word.  This  would  have  to  be  done  by 
special  1/0  hardware  or  by  software 
which  would  unpack  and  pack  the  dis- 
crete inputs  and  outputs,  respecti vely  . 

The  benchmark  programs  were  run 
on  the  following  computers: 

Harris  SLASH  4 
Harris  SLASH  7 
Interdata  8/32 
SEL  32/55 
MOnCOMP  IV/25 
DEC  KL-10 
NORSK  NORD  50 


The  results  of  the  test  runs  on  each 
computer  are  shown  in  Table  5. 

The  size  of  the  FORTRAN  Memory 
Totals  in  the  table  is  a measure  of: 
(1)  compiler  efficiency  and  (2)  in- 
struction set  power.  The  first  of 
these  two  factors  is  more  predominant. 
The  size  of  the  FORTRAN  Time  Totals  in 
the  table  provides  a measure  of  com- 
puter hardware  execution  speeds  as 
well  as  the  factors  mentioned  above. 

All  of  the  FORTRAN  memory  and  run 
time  data  shown  in  the  tables  repre- 
sent actual  benchmark  runs  except  for 
those  marked  with  an  asterisk  (*)  to 
designate  "projected  results." 

The  SEL  32/55  FCMOM  results  were 
generated  by  substituting  specified 
instruction  execution  times  of  the 
floating  point  hardware  for  the  times 
of  the  firmware  instructions  actually 
executed  in  the  benchmark  run.  The 
NORD  50  benchmark  results  were  updated 
from  the  actual  results  by  factoring 
in  the  effect  of  a pending  compiler 
modification  which  enables  direct, 
rather  than  indirect,  addressing  of 
FORTRAN  common  variables.  And,  as 
mentioned  earlier,  the  Interdata  8/32 
FORTRAN  VII  '•esults  were  obtained  by 
hand-optimizing  the  code  generated  by 
the  existing  FORTRAN  VI  compiler  ac- 
cording to  the  desigri  specification  of 
the  FORTRAN  VII  compiler. 

DISCUSSION  OF  BENCHMARK  RESULTS 

The  objective  of  this  portion  of 
the  paper  is  not  to  compare  architec- 
tures of  the  seven  computers  shown  in 
Table  5.  However,  it  is  appropriate 
to  classify  the  computers  into  three 
groups:  large  scale,  "midicomputer," 

and  minicomputer.  According  to 
Theis'^,  a "mi  d i computer " is  a high- 
performance  machine  with  a mid-length 
word  size  and  a less  than  midsize 
pricetag.  Classifying  the  computers 
then,  the  DEC  KL-10  w.th  its  36-bit 
word  size  is  definitely  a large-scale 
computer,  the  MODCOMP  IV/25  with  its 
16 -bit  word  size  is  a minicomputer, 
and  the  remaining  five  computers  with 
their  24-  and  32-bit  word  sizes  are 
midi  computers . 

As  might  be  expected,  the  DEC  KL- 
10  provided  the  best  memory/time  effi- 
ciency using  1 less  memory  and  40T 
less  execution  time  than  the  baseline 
Harris  SLASH  4 assembly  language 
benchmarks.  However,  associated  with 
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TABLE  5.  BENCHMARK  RESULTS 


Tassemblyi 

FORTRAN 1 

COMBINED  TOTALS  OF 

INTERDATA 

NORSK 

FCMOM  & ELECT 

HARRIS 

DEC 

HARRIS 

HARRIS 

8/32 

SEL 

NORD  iMODCOMH 

BENCHMARKS 

SLASH  4 

KL-10 

SLASH  4 

SLASH  7 

FORTRAN  VII 

32/5^ 

50 

IV/25 

★ 

★ 

★ 

MEMORY  TOTAL  (WORDS) 

% MEMORY  CHANGE 

790 

786 

940 

948 

867 

81  6 

964 

997 

(FORTRAN  VS  HARRIS 
SLASH  4 ASSEMBLY 

language) 

-1 

19 

20 

10 

3 

22 

26 

TIME  TOTAL  (MSEC) 

1511 

907 

1754 

1448 

1 250 

1147 

1460 

2898 

% TIME  CHANGE 
(FORTRAN  VS  HARRIS 
SLASH  4 ASSEMBLY 

LANGUAGE) 

-40 

16 

-4 

-17 

-23 

-3 

92 

J 

♦PROJECTED  RESULTS 
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the  high  performance  of  this  large 
scale  computer  is  a large  scale  price 
tag.  The  memory  efficiency  of  the 
five  mi di computers  ranged  from  21% 
more  memory  than  baseline  for  the  NORD 
50  to  only  3%  more  memory  than  base- 
line for  the  SEL  32/55.  The  execution 
time  efficiency  of  these  computers 
ra,.ged  from  16%  more  time  than  base- 
line for  the  Harris  SLASH  4 to  24% 
less  time  than  baseline  for  the  SEL 
32/55.  The  MODCOMP  IV/25  provided  the 
least  efficient  results  (26%  more  mem- 
ory and  92%  more  time)  mainly  because 
it  is  basically  a 16-bit  machine  with 
a limited  32-bit  capability  added  on. 
This  results  in  two  16-bit  memory  ac- 
cesses for  each  32-bit  word  and  an 
accompanying  increase  in  execution 
time. 

All  of  the  computers  in  the  table 
made  use  of  optimizing  compilers  in 
the  benchmark  runs. 

SUMMARY 

A summary  of  the  results  of  the 
limited  analysis  of  FORTRAN  efficiency 
performed  for  this  paper  are  presented 
below: 

•An  average  memory  penalty  of  17% 
and  time  penalty  of  16%  was  in- 
curred for  four  types  of  process- 
ing (Table  2)  in  a Harris  FORTRAN 
vs  assembly  language  efficiency 
comparison.  This  was  further  con- 
firmed by  the  combined  benchmark 
totals  for  the  Harris  SLASH  4 
(Table  5)  where  the  memory  penalty 
was  19%  and  the  time  penalty  was 
16%.  According  to  Trainor  and 
Burlakoff^,  these  results  are  con- 
sistent with  published  results  for 
other  comparable  HOLS  that  have  in- 
dicated a 10%  to  20%  penalty. 

•An  average  memory  savings  of  43% 
and  time  savings  of  29%  (Table  3) 
was  achieved  in  an  optimizing  vs. 
non-optimizing  FORTRAN  compiler 
compari son . 

•A  memory  savings  of  32%  and  time 
savings  of  23%  was  achieved  in  a 
comparison  of  two  optimizing  com- 
pilers. 

•Benchmark  results  for  seven  can- 
didate simulation  computers  were 
presented  exhibiting  a wide  range 
of  memory  and  execution  time  effi- 
ciencies. 


CONCLUSIONS 

FORTRAN  efficiency  is  an  impor- 
tant factor  in  evaluating  the  perform- 
ance of  computers  for  training  simula- 
tors. From  the  results  of  the  analy- 
sis of  FORTRAN  efficiency  summarized 
above,  the  conclusions  are  as  follows: 

• Minimal  execution  time  and  memory 
penalties  are  incurred  for  most 
types  of  processing  which  are  per- 
formed in  training  simulators. 

• An  optimizing  compiler  is  essential. 

• An  optimizing  compiler  that  per- 
forms extensive  optimization  is 
highly  desirable. 

• A comparison  of  benchmark  results 
must  be  performed  to  assess  rela- 
tive efficiencies  of  candidate 
computers . 
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IMPACT  OF  MICHOPROCEOOORO  ON 
TRAINING  DEVICES 

GHtRY  C.  WHITi: 

Naval  Training  r/iuipriimt  Center 


INTRODUCTION 

Simulation  has  long  been  accepted  as  a 
cost— ‘flective  training  method  and  is  becoming 
more  valuable  due  to  the  energy  crisis.  By 
simulating,  operational  systems,  trainers 
reduce  the  use  of  oper.ational  equipment  and 
contribut’-  to  fuel  savings.  Not  only  do  savings 
result  from  reduced  energy  consumption,  but 
also  from  fewer  opt-U-ationai  units  being 
re:}aired  'ind  from  a aecrease  in  potenti-aj.  acci- 
ents  during  trainin.-. 

The  computer  system  in  training  devices 
must  be  capable  of  pt'rformance  necessary  to 
meet  system  requirements,  'ieneraiiy,  this  will 
me  -in  a him  degree  of  complexity  at  both  the 
hardw;ire  and  softwire  levels.  Maintenance 
and  reli.aoility  re-juire  that  the  system 
•irchitect;ure  be  the  simplest  that  will  meet 
gyster.  p.-rformruice  requirements,  yet  the 
complexity  of  the  simulation  demands  the  most 
mature  design  within  the  state-of-the-art. 

Early  simulators  were  .'irialog  devices. 
R-'programrang  them  required  “Xt-nsive  circuit 
moill'i cations  and  involved  consid-  rable 

■ xrxndit'iT'-.s  of  time  'ind  money. 

Th-'  advent  of  genera]- purpose  digital 
L'otiiputer;.'  I'd  to  the  development  of 
aigorithiro  suitable  for  modeling  both  discrete 
••Uid  continuous  syste..is.  When  these  computers 
beC'ime  sufficiently  fast,  r--al-time  digital 
simulation  was  a reality.  Digital  computers 
W'-rc  bein.'  u...- d In  trainers  as  early  as  196.?. 

The  US'  of  digital  coraput'-rs  in  simulators 
.ha.  p’su.ted  in  mor"  fi-.-xibi'.-  tr.aining  devices. 
Digital  cofaputer.:  m.ay  r-' ;uir‘’  only  n- 1 ativ'.-ly 
ssmpl'  ch'mg'  S in  the  siniuiation  program  to 
Inc'jrporat'.-  •■nn.'incem<'nt3  in  th''  rr.o<j>'l.  A 
.•re-iter  part,  of  m'Xiificat  i'jn  cost  is  in  th*- 
..oftwar'-  area.  This  addition.ai  softwar'  cost 
can  som'-wnat  offs'  t by  r'-ducer!  hardware 
co.'t.  Tt;'  i fe  of  a trainer  can  also  be 

■ xt'  nd'.'d  by  r'  progr'imming  t o incorporate 
van  su.;  ch.anges  in  th'-  op  rational  equipment. 

Although  simulatl  in  is  .a  cost— ■ffertiv'- 
tralniri;'  meth'Xj,  the  .simulators  th'-mselves 
c-an  he  exp-nsiv'  . Th'-  training  d'.'vice 

cost  11''.!  million.'^'  Cost  constraints  now 
arid  in  th"  future  r-'  juir>'  that  a high  I'o'r'  '- 
of  "fr'ictiveness  be  obtain'd  at  the  s.ame  or 
at  r'-duced  coats.  ll'vic'S  such  as  iow-cost 
ml'-r  jpfoC'  sr.'ir  ; sh'iul'i  b''  consld'Ted  in  th<' 

'iesi.ai  if  training  devic''  . 


THii  MICROFROCfriGOR 

Microprocessors  are  nip-  that 
function  somewhat  lik*  a minicomputer, 
usually  at  a slower  speed  and  with  a s.horter 
word  length.  They  ar'  , or  will  become,  an 
important  part  of  common  devices  in  the 
home  imd  in  industry.  PDint-of-sale 
terminals,  cash  regist'.'rs,  television  S'  ts, 
traffic  lights,  and  even  pinball  machines 
are  currently  being  controlled  by  micr'u- 
processors.  It  has  been  esti.m.ated  that  by 
1980  there  will  be  60  million  micro-  /.  .. 
processors  us',>d  in  microcomputers  alone. 
Microprocessors  replace  hardwired  logic 
or  minicomputers  in  such  applications,  hut 
are  often  used  for  entirely  now  purpos-js. 

The  microprocessor's  rapid  growth  is 
due  to  its  great  computing  p'jwer  at  low  cost. 
Although  hardware  cost  will  d-ocrease 
drastically  as  microprocessors  assume  mor'” 
functions  in  training  devices,  the  total 
system  cost  is  likely  to  remain  constant. 
Software  will  become  even  more  compl- x -and, 
th-  refore , software  support  will  consume  a 
l.-irger  part  of  the  total  cost. 

The  use  of  microprocessors  to  r'  place 
hardwin'd  logic  gives  the  designer  th-.- 
opportimity  to  make  easy  production  changes. 

New  features  can  be  added  in  the  prototype 
stage  without  laying  out  new  circuit  boards. 

Microprocessor  controllers  can  be 
applied  to  most  d'.'vlces  .'uad  optimized  for  a 
particular  application.  Dev'iopm'-nt  tin'' 
for  a microprocessor  controlled  system  can 
be  as  little  as  ori' ’-third  that  of  a hard- 
wired system,  v.^)  . actual  time  dep'-nds 

upon  support  softw.ar'’  available  and  on  the 
d'jsign'-r ' j e.'CfvTiene”  with  miivotirocessors. 

It  c.an  be  anticipated  that  most  devices 
requiring  logic  controls  will  '.'ventually 
includ'’  one  or  mori-  microprocessors. 

Debugging  microproc'issor  systems 
presents  fi’w  problems,  being  no  mor',- 
difficult  .’itKl  requiring  no  more  time  than  for 
hardwired  logic  systems.!^'  'Phe  process  can 
be  accelerated  by  simulating  the  micro- 
processor on  a lar'g'-r  machini’  and  testing  the 
progr.'ims  prior  to  implementation. 

Ther'-  an’  num'-rous  reasons  for  considering 
the  use  of  microprocessors  in  training  devices. 
A few  of  these  .an': 
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a.  More  powerful  simulation  systems 
may  result  if  microprocessors  are  used  as 
building  blocks. 

b.  Power  consumption  is  low. 

c.  Systems  can  be  more  flexible  when 
microprocessors  are  incorporated  into  their 
design. 

d.  Overall  system  reliability  is 
increased  by  using  high-reliability  micro- 
processors and  from  reducing  parts  count  and 
decreasing  the  number  of  interconnections. 

e.  The  microprocessor  is  smaller  than 
the  circuits  it  replaces  and  its  use  results 
in  smaller  equipment. 

f.  The  microprocessor  may  be  used  for 
new  applications  in  the  training  device. 

Over  40  percent  of  the  microprocessors  now 
in  use  are  being  used  for  entirely  new 
purposes. 

g.  The  microprocessor  may  introduce  a 
cost  saving  when  used  to  replace  hardwired 
circuits. 

h.  Design  time  can  be  decreased  resulting 
in  a reduction  in  cost. 

SOFTWARE  FCR  MICROPROCESSCHS 

As  simulation  becomes  more  realistic, 
providing  better  sensory  effects,  software 
may  become  more  complex.  Microprocessors 
and  other  developments  in  electronics  will 
likely  result  in  better  simulation  at  a 
lower  hardware  cost  but  will  place  greater 
demands  on  software  engineering. 

A good  software  system  requires 
thorough  analysis  prior  to  design.  A 
systems  engineering  approach  is  essential 
to  minimize  the  cost  of  the  trainer,  the 
initial  software  cost,  and  software  modifi- 
cation throughout  tne  life  of  the  trainer. 

Programming,  coding,  and  assembly  of 
programs  require  extensive  effort.  Debugging 
and  verification  of  programs  are  time 
consuming  tasks.  Pl-ogram  modification  at  a 
later  date  will  re(}uire  extensive  effort 
and  spt:cial  skills.  In  the  past,  management 
has  directed  its  attention  toward  hardwau'e 
(and  also  has  placed  budget  emphasis  in  this 
area). 

P'^rfomicince  requirements  are  increasing 
rapidly,  find  although  softw.are  cost  is 
increasing,  its  rate  is  not  as  fast.  It 
has  been  estimat'fd  that  computer  software 
costs  'ire  tIir<;e-to-four  times  as  gri'at  as 


computer  hardware  costs.  Forty-to-fifty 
percent  of  software  cost  occurs  during 
hardware-software  interaction  checkout. 
Additional  demands  will  be  placed  on  the 
software  staff  as  microprocessors  assume 
more  functions  in  operational  equipment  and 
in  simulators. 

UNGUAGES  FCR  FROCRAMMING  MICR0PR0CE33CR3 

Despite  the  many  advantages  quoted  for 
microprocessors,  their  use  requires  a 
thorough  knowledge  of  the  relationship 
between  software  and  hardware.  The 
programning  of  microprocessors  takes  ^ 
considerable  effort.  Texas  Instruments 
estimates  that  a small  program  of  less 
than  2000  instructions  can  consume  20, 
to  30  working  days  if  sufficient 
support  software  is  available.  Other 
estimates  (^)  j'a^ge  as  low  as  50 
instructions  per  man-month. 

The  most  direct  means,  but  also  the 
most  time  consuming  programming  method,  is 
the  use  of  machine  language.  At  this  level, 
the  programmer  is  closest  to  the  internal 
operations  of  the  microprocessor  and  must 
maintain  full  knowledge  of  register  usage 
and  memory  allocation.  Programming  of 
microprocessors,  however,  can  be  simpli- 
fied with  any  of  several  languages. 

Assembly  language,  with  its  mnemonic 
op-codes,  symbolic  addresses,  and  one-to- 
one  correspondence  with  machine  language, 
makes  programming  somewhat  easier. 

Assembly  language  also  has  advantages  over 
higher  level  languages.  About  one-half  the 
code  generated  by  the  high-level  compilers 
is  produced  by  an  assembler.  This  results 
in  shorter  execution  time  (for  assembied 
programs)  which  is  especiadly  important  in 
real-time  simulation.  Trainers,  for 
example,  must  respond  rapidly  if  they  are 
to  reproduce  actual  system  response. 

Higher  level  languages  eliminate  the 
need  for  the  programmer  to  manage  register 
usage  or  to  allocate  memory.  In  addition, 
structured  programs  are  possible,  leading 
to  more  reliable  programs  with  fewer 
opportunities  for  errors.  Documi’ntation  is 
better  and  enhancements  are  easily  added. 

A possible  disadvantage  is  that  the  program- 
mer is  further  removed  from  the  machine  and 
has  less  control  over  memory  allocation  and 
register  usage.  More  memory  is  recjuired 
and  execution  time  is  also  increased. 

Higher  level  language  is  pres"ntly  new  and 
l.-irgely  unused  in  the  microprocessor  field. 

Assembly  lan^^age  is  commonly  used  for 
writing  microprocessor  programs  and 
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accounts  for  about  fxTccnt  of  the 
prOfT^uiiminf  in  this  area.  Although 

resicient  assemblers  are  available,  cross- 
assemblers  (if  a host  computer  is  available) 
seems  to  be  the  usual  method  for  programming 
microprocessors.  Macro-instruction 
facilities  may  be  desirable  and  are  easily 
made  available  on  the  host  computer. 


The  microprocessor  in  this  training 
device  also  stores  and  updates  velocity  and 
climb/dive  rates,  sums  velocity  vectors, 
computes  radar  slant .ranges  and  target 
elevation  angles.  The  functions 

handled  by  the  microprocessors  would  have 
previously  required  a minicomputer. 

CONGLUSIOH3 


M1CR0H10CES30R3  AND  TRAINING  DEVICES 

The  development  of  training  devices 
utilizing  microprocessors  as  controlling 
subsystems  requires  reorientation  of 
priorities  and  resources.  IVograms 
written  for  microprocessors  in  control 
applications  consist  of  a sequence  of 
instructions  to  implement  the  desired 
behavior.  Programming  these  devices 
requires  the  skiils  of  a person  who  is 
familiar  with  both  hardware  and  software. 

A major  part  of  the  cost  when  using  micr'>- 
processors  is  in  the  design  of  software. 

In  order  to  obtain  the  potential  benefits 
offered  by  microprocessors,  additional 
emphasis  must  be  placed  on  software 
engineering  and  progr.im  development. 

M'  dium-scale  computers  now  provide 
sufficient  conti^ol  for:  modei'n  training 
devices.  -As  equipment  bei.ng  simulated 
become  more  complex,  more-  powerful 
simulation  will  be  required  if  the 
training  device  is  to  provide  adequate 
training.  Microprocessors  can  bo  ki;y 
elem'^nts  in  such  systems.  Providing  control 
and  Sfjme  c<xnputing  functions  at  physically 
separated  locations,  microprocessors  will 
allow  a more  complex  simulation  and  provide 
for  improved  prformance. 

An  ■■xan.pl-  of  curr'-nt  applications  of 
microprocessors  in  training  devices  gives  an 
indication  of  the'  potential  uses  of  micno- 
processors  in  simulation.  l(/drosystem' s 
air-traff ic-control/r.ariar  simulator, 
inte-rfaced  with  on-.^ite  radar  systems, 
pre'sents  both  live  ,-mq  simulated  r-adar  f-turns 
to  the'  trainee,  Pseud'j-pilots  enter 
c'xiin.ands  in  response  to  the  audio  commu- 
nications from  the  trainee  .-md  simulated 
aircraft  resp<jnd  according  to  parani'-ters 
stored  in  re.-id-'anly-me-mor ios.  Micro- 
processors p rforiti  block-tr'insf'-r  of  data 
•ind  tr.'insformations  from  rect-un^ilar  to 
p(jiar  coordinates. 


Numerous  innovative  applications  of 
the  microprocessor  are  an  indication  of 
its  versatility.  Uses  of  the  micro- 
processor in  training  devices  include  the 
replacement  of  hardwired  logic  and  some 
fxmetions  currently  being  performed  by 
minicomputers. 

Although  the  microprocessor  should 
be  considered  as  a means  of  reducing 
hardware  costs,  other  benefits  of  its  use 
should  not  be  overlooked.  Microprocessor 
programs  are  easily  altered  and  can  extend 
the  life  of  the  training  device  by 
facilitating  equipment  modifications  or 
by  providing  for  enhancements  necessary 
for  improved  simulation. 

With  their  low  cost  and  large 
computing  power,  microprocessors  may  be 
used  as  building  blocks  throughout  the 
training  device.  Each  of  these  micro- 
processors can  contribute  to  the  effec- 
tiveness of  the  simulation  by  providing 
for  data  acquisi* ion  and  data  conversion, 
by  p-r-rforming  simulation  functions,  or  in 
control  applications. 

Pot^-ntial  applications  of  the  micro- 
processors in  simulators  an.'  not  limited 
to  replacing  existing  hardware  and  mini- 
comput''r  functions.  Because  of  its  avail- 
ability and  flexibility  it  is  likely  that 
entirely  new  functions  for  the  micr'3- 
processor  will  evolve  that  will  contrioute 
to  more  ''ffective  simulation. 

Futur*'  applications  of  microprocessors 
in  training  devices  are  limited  by  both 
th"  imagination  of  the  design  engineer 
■ ind  his  knowledge  of  programming  techniques. 
Until  engin'eers  acquire  th"  programming 
skill  that  c?in  only  be  obtained  through 
y"-'ir:;  of  programming  exp-rience,  th'y 
must  dep-nd  upon  softwar'"  exp-rts  to 
assist  them  in  their  work  with 
microprocessors. 
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INTRODUCTION 

The  Computer  Assisted  Operations  Re- 
search Facility  (CAORF)  is  a highly 
sophisticated  ship  maneuvering  simu- 
lator owned  and  operated  by  the  Na- 
tional Maritime  Research  Center.  It 
was  designed  primarily  as  a high  fi- 
delity simulator  to  conduct  a broad 
spectrum  of  applied  maritime  research. 
A secondary  role  has  emerged  for  CAORF 
for  the  specialized  training  of  VLCC 
masters  in  ports  such  as  Valdez,  A- 
laska.  The  cost  of  CAORF  training  for 
Valdez,  in  terms  of  resource  conser- 
vation and  other  factors,  has  been 
demonstrated  to  be  much  less  than  the 
cost  of  comparable  at-sea  training. 
Recent  interest  by  the  maritime  indus- 
try for  the  increased  use  of  simulator 
training  will  require  prototype  devel- 
opment; CAORF  is  the  ideal  facility 
for  this  type  of  maritime  training  re- 
search. Hence,  multiple  roles  have 
emerged  for  this  facility:  1)  to  con- 
duct research  on  operational  maritime 
problems;  and,  2)  to  develop  maritime 
training  programs  and  identify  train- 
ing device  characteristics.  Both  of 
these  roles  exemplify  aspects  of  the 
goal  of  resource  conservation  through 
simulation.  The  effectiveness  of 
achieving  this  goal  is  addressed  in 
this  paper  in  terms  of  CAORF  valida- 
tion, the  extent  to  which  mate  behav- 
ior on  CAORF  is  similar  to  mate  behav- 
ior at  sea  . 

CAORF  was  designed  as  a research  tool 
to  enable  the  conduct  of  investiga- 
tions that  would  be  prohibitive  to  ac- 
complish at  sea.  The  extensive  capa- 
bilities designed  into  CAORF  for  this 
purpose  also  enable  its  use  as  an  ad- 
vanced training  device.  A high  fidel- 
ity wheelhouse  environment  is  simu- 
lated, representing  the  state-of-the- 
art  in  merchant  ship  bridge  simulation 
(see  Figure  1).  The  major  elements 
of  simulation  include:  1)  the  full 
compliment  of  ship  instrumentation, 
such  as  radar  and  navigation  equip- 
ment; 2)  ship  handling  characteristics. 
Such  as  wind  effects,  turning  equa- 


tions, and  tugboat  forces;  and,  3)  a 
comprehensive  visual  scene.  The  com- 
puter-generated visual  imagery,  sub- 
tending a 240°  horizontal  arc  and  a 
24°  vertical  arc,  is  the  most  unique 
feature  of  CAORF.  The  full  color  vis- 
ual scene  can  be  constructed  of  any 
area  and  changed  in  real-time  as  a 
function  of  own  ship  and  other  ship 
actions.  The  visual  scene  can  vary 
according  to  day/night,  level  of  visi- 
bility, and  color  factors.  It  can  in- 
clude parts  of  own  ship,  other  ships, 
coastline,  bridges,  buildings,  oil 
rigs,  and  other  visual  objects. 

Of  equal  importance  to  the  quality  of 
the  simulation  are  the  control  and 
performance  monitoring  capabilities 
(see  Figure  1).  These  are  essential 
from  both  a research  and  training 
standpoint.  The  remotely  located  Con- 
trol Station  provides  a complete  set 
of  indicators  and  displays  for  moni- 
toring the  actions  of  own  ship  and 
other  ships.  These  include  monitors 
of  the  visual  scene,  geographic  plots, 
radar  repeaters,  and  communication 
panels.  Interrogation  and  control  of 
all  problem  parameters  may  be  accom- 
plished from  the  Control  Station.  The 
Human  Factors  Station  compliments  the 
Control  Station  by  providing  a variety 
of  remotely  controlled  audiovisual 
monitors  for  observing  behavior  on  the 
bridge.  These  two  stations  permit  re- 
mote observation  and  exercise  control 
by  a researcher  or  instructor.  Fur- 
thermore, interaction  with  the  mate  or 
master  on  the  bridge  can  be  accom- 
plished via  CRT  displays  on  the  bridge 
and  radio/telephone  communication. 
Extensive  computer  facilities  enable 
the  on-line  calculation  of  performance 
measures,  provide  for  immediate  feed- 
back if  desired,  and  provide  for  com- 
prehensive post-exercise  analysis. 
These  extensive  control,  performance 
monitoring,  and  computational  fea- 
tures, although  designed  for  the  con- 
duct of  research,  are  excellent  train- 
ing assistance  capabilities.  They 
provide  the  training  program  developer 
and  instructor  with  a wide  range  of 
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capabilities  with  which  to  develop  and 
impl ement  training. 

The  effectiveness  of  a high  fidelity 
simulation  facility  in  the  conduct  of 
applied  research,  or  in  providing  ad- 
vanced training,  is  dependent  on  the 
validity  of  elicited  behavior.  The 
purpose  of  incorporating  a high  degree 
of  fidelity  is  to  assure  obtaining  be- 
havior on  the  simulator  that  is  simi- 
lar to  behavior  that  occurs  in  the 
real  world  environment.  Validation  of 
the  CAORF  simulator  was  undertaken  for 
this  purpose,  in  essence  to  ensure 
ttiat  findirxjs  on  CAORF  have  a positive 
relationship  to  those  expected  at  sea. 

The  issue  of  simulator  validation  may 
be  addressed  in  three  distinct  areas: 

1.  Hardware  Validation  - e.g.,  eg  na- 
tions of  ship  mo  t i on . 

Perceptual  and  Information  Pro- 
cessing Validation  - the  mate's 
perceptual  integration  of  simu- 
lated information  (e.g.,  visual 
estimation  of  target  range). 
Behavioral  Validation  - the  mate's 
behavioral  functioning  (e.g.,  the 
■I'ate's  rada  r - re  I a t ed  behavior). 

The  tnir'd  area  o validation,  mate  be- 
'laviar,  i j addressed  by  tiiis  paper. 

'hi.  area  is  of  fundamental  inipot  lance 
1 'I  tfiat  it  may  serve  as  a summaiy  of 
*he  ’’rst  two  areas,  as  well  as  direct- 
y relate  to  ship  per  f a rma  nc  . 

This  validation  project,  which  was 
-ponsored  by  the  national  Maritime  Re- 
search Center,  was  tailored  to  inves- 
tipate  a variety  of  validation  issues 
of  soneern  to  CAORF.  Tfie  most  impor- 
tant were: 

1.  The  mate's  level  of  activity  and 
radar  behavior  as  .i  function  of 
situation  conditions, 
y . Lxa mi  nation  of  the  existence  and 
111  a g n i t u d e of  a 1 e a r n i n g / e x p e ri  - 
ence  factor  when  the  mate  ini- 
tial ly  reports  on  the  CAORl 
bridge,  and 

'5.  Comparison  of  research  findings 
between  research  performed  at 
sea  and  on  CAORF. 

behavioral  validation  approach 

Behavioral  validation  was  accomplished 
by  comparing  the  behavior  of  mates  on 
CAORF  with  the  befiavior  of  mates  in 
similar  situations  at  sea  (see  Figure 
2)  . An  at-sea  data  base  consisting 
of  mate  behavior  was  compiled  from  a 
variety  of  trips  at  sea.  Tiiis  computer 


data  base  also  contains  reconstruc- 
ted target  and  own  ship  data  for  the 
various  at-sea  situations.  Three  four- 
hour  watch  scenarios  were  constructed 
for  use  on  CAORF  from  these  data.  The 
watches  were  identical  to  situations 
that  had  occurred  at  sea  near  the 
Cheasapeake  Bay,  Mata n ilia  Shoals  in 
the  Straits  of  Florida,  and  the  English 
Channel.  The  behavior  of  mates  who 
stood  watch  on  the  CAORF  bridge  during 
the  constructed  scenarios  (ten  mates 
total)  was  compared  with  the  mate  be- 
havior observed  during  the  similar 
situations  at  sea  . 

The  three  selected  ’t-sea  situations 
covered  a broad  rai.  ,6  of  conditions  to 
provide  for  the  general  applicability 
of  the  validation  results  (see  Figure 
3).  A variety  of  information  was  de- 
veloped for  each  watch  based  on  the 
at-sea  situation:  1)  own  ship  data; 

2)  target  data;  3)  environmental  con- 
ditions; 4)  communications  guidelines; 
5)  geographical  data;  and,  6)  ship  in- 
formation and  materials.  In  essence, 
the  mate  reported  for  watch  on  the 
CAORF  bridge  is  a duplicate  of  a wafih 
that  had  occurred  at  sea. 

The  data  collection  methods  employed 
on  CAORF  were  identical  to  tfiose  uP>d 
at  sea.  A trained  observer  recorged 
the  pertinent  information  concef'ii  ; 
the  'Date's  tasks.  A variety  t,i-.  i 
categories  were  identified  for  ‘he  at- 
sea  data  collection  efforts,  and  al  ' 
used  to  classify  the  tasks  observed  >-r, 
CAORF.  More  than  seventy  distinct 
task  categories  were  considered  and  or 
tfie  following  majoi'  areas;  1)  ship 
control;  2)  navigation;  3)  communica- 
tion; 4)  visual;  5)  contact  assessment; 
and,  6 ) logging  and  miscellaneous. 

Tfie  validation  analysis  was  conducted 
in  three  separate  configurations: 

1.  CAORF  Watch  Behavior  Versus  The 
Identical  At-Sea  Watcti  Behavior- 
Tfie  advantage  of  tiiis  approach 
was  that  CAORF  behavior  could 

be  compared  with  at-sea  behav- 
ior under  identical  conditions. 
The  disadvantage  w.is  That  the 
behavior  of  only  one  mate  per 
at-sea  watch  could  be  used  for 
the  analysis. 

2.  CAORF  Situation  Average  Versus 
Similar  At-Sea  S i t u <i  t i o n Ave- 
rage - The  three  CAORF  watche-- 
were  partitioned  into  segments 
on  the  basis  of  the  situation 
conditions;  average  behavioral 
data  were  calculated  across  the 
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Figure  2.  Behavioral  Validation  Approach 
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similar  segments.  The  entire 
at-sea  data  base  was  likewise 
partitioned  into  segments,  and 
behavioral  averages  developed. 
The  advantage  of  this  approach 
was  that  the  at-sea  data  for 
each  situation  were  based  on 
the  behavior  of  several  mates. 

3.  Overall  CAORF  Average  Versus 
Overall  At-Sea  Average  - This 
approach  developed  average 
data  across  all  CAORF  watches, 
regardless  of  the  situation 
conditions.  The  at-sea  data 
were  similarly  averaged.  This 
approach,  although  used  to  com- 
pare behavioral  data,  was  pri- 
marily used  for  comparison  of 
CAORF  and  at-sea  ship  perfor- 
mance. 

The  analysis  investigated  similarities 
and  differences  in  mate  behavior.  Be- 
havioral variables  that  received  par- 
ticular attention  were:  1)  Task  Work- 
load - the  percentage  of  a mate's  time 
that  was  spent  doing  particular  tasks 
(e.g.,  a 20  radar  workload  means  that 
the  mate  spent  three  minutes  out  of 
fifteen  minutes  performing  radar  tasks); 
2)  Task  Frequency  - the  number  of  times 
in  a given  period  that  the  mate  per- 
formed particular  tasks;  and,  3)  Task 
Duration  - the  average  amount  of  time 
the  mate  spent  performing  a task.  A 
contact  load  algorithm  was  used  to  pro- 
vide an  objective  estimate  of  the  load- 
ing placed  on  the  iiiate  by  the  distri- 
o.tion  .T  .’-ip  ' intact’..  Tne  contact 
load  algoritnm  was  developed  in  an 
earlier  study  investigating  standard- 
ized bridge  design  (Eclectech  Associ- 
ates, 1976).  The  contact  load  para- 
meter is  sensitive  to  the  number  of 
contacts  (fixed  or  moving),  their 
range,  bearing,  speed  .and  course. 

This  algorithm  was  particularly  use- 
ful in  partitioning  the  watches  into 
equivalent  segments. 

FINDINGS 

Mate  behavior  on  CAORF  was  found  to  be 
similar  to  mate  behavior  at  sea.  The 
level  of  mate  activity,  the  type  of 
tasks,  and  the  manner  in  which  the 
tasks  were  performed  were  found  to 
change  in  accordance  with  the  situa- 
tion conditions,  both  on  CAORF  and  at 
sea.  A summary  of  the  validation 
findings  is  presented  in  this  paper. 

The  interested  reader  is  referred  to 
Hamme  1 1 ( 1 76  ) for  the  complete  report. 

Overall  comparisons  between  mate  be- 


havior on  CAORF  and  at  sea  are  shown 
in  Figure  4.  CAORF  and  at-sea  work- 
loads are  averaged  across  all  the  da- 
ta for  three  sets  of  situation  condi- 
tions. Tiie  data  are  further  broken 
down  according  to  All  Tasks  and  Radar 
Tasks  categories.  A relatively  high 
correlation  coefficient  was  obtained 
for  these  data  (Spearman  Rank  Corre- 
lation Coefficient;  T 0.9,  p<.05), 
demonstrating  relative  similarity  in 
mate  behavior  on  CAORF  and  at  sea. 

Behavior  During  the  Watch 

Mate  behavior  during  the  watch  is  ex- 
emplified by  the  data  for  Watch  ><2, 
Matanilla  Shoals  area,  shown  in  Fig- 
ure 5.  The  upper  curve  shows  the 
dimensionless  contact  load  as  a func- 
tion of  time  during  the  watch.  A 
contact  load  of  zero  through  ten  in- 
dicates a low  level;  15  through  30 
indicates  a medium  level;  30  and  above 
indicates  a high  level.  The  contact 
load  reached  a low-level  peak  around 
0900  and  a high-level  peak  around  1130. 
The  lower  curves  show;  l)  the  mate 
workload  on  CAORF  during  the  four- 
hour  watch,  for  all  tasks,  and  aver- 
aged over  the  six  mates  that  stood 
this  watch;  and,  2)  the  mate  workload 
at  sea  during  the  similar  watch,  for 
all  tasks,  and  for  the  one  mate  that 
stood  watch.  Inspection  shows  that 
the  mates  usually  had  a higher  level 
of  activity  on  CAORF.  Much  of  this 
difference  may  be  attributed  to  a 
1 ea rn i ng/ expe r i e nee  effect,  which  is 
discussed  later.  The  workload  peaks 
near  0900  and  1115-1145  correspond  to 
the  contact  load  peaks;  the  workloads 
during  these  times  are  primarily  due 
to  contact  assessment  tasks  (e.g., 
reflection  plotting  on  radar).  The 
workload  peaks  around  1000  we>'e  due 
to  navigation  tasks  te.g.,  plotting  a 
LORAN  fix).  The  similar  workload 
trends  of  the  CAORF  mates  and  the  at- 
sea  mate  during  the  watch  (i.e.,  peaks 
around  0900,  1000,  and  1115-1145)  show 
the  correspondence  between  CAORF  and 
at-sea  behavior  as  a function  of  the 
situation  conditions. 

B e h_a  V i or  Ave r_aj£_d  Acros s S i m i 1 ^r 
Sj't_u^t'i  oinj  ~ 

Greater  confidence  in  the  behavioral 
comparisons  may  be  had  when  the  CAORF 
data  are  compared  with  averaged  at- 
sea  data,  reducing  the  potential  bias. 
The  three  CAORF  watches  and  the  entire 
at-sea  data  base  were  partitioned  in- 
to segments  based  on  the  situation 
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TASK 

SLA  CONDITION/ 
CONTACT  LOAD 

WORKLOAD  ( ) 

CAORF 

AT-SEA 

ALL  TASKS 

OPEN  SLA/LOW 

27 .0  ■ 

1 5 . 6 ,4 

OPEN  SEA/HIGH 

48.2 

32.60 

RESTRICTED  WATERS/ 
LIMITED  VISIBILITY 

47.6 

b4 . 00 

RADAR 

OPEN  SEA/LOW 

12.0 

6.00 

OPEN  SEA/HIGH 

34  . 4 

20.00 

RESTRICTED  WATERS/ 
LIMITED  VISIBILITY 

30.0 

22.00 

riyure  4.  CAORF  and  At-Sea  Workload  Comparison  Suminary 

(Spearman  Rank  Correlation  Coefficient:  .9(p<.05) 
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conditions.  Three  distinct  groups  of 
segments  were  identified  from  the 
CAORT  watches  on  the  basis  of  the  sit- 
uation conditions:  1)  open  sea,  good 
visibility,  low  contact  load;  2)  open 
sea,  good  visibility,  high  contact 
load;  and,  3)  restricted  waters,  limit- 
ed visibility,  high  contact  load.  The 
average  workloads  for  all  tasks  during 
these  segments  show  that  the  mate  work- 
load differences  between  the  three 
groups  of  situations  on  CAORF  are  si- 
milar to  those  at  sea  (see  Figure  6). 
These  similarities  extend  to  specific 
task  areas  as  well  (e.g.,  radar  tasks). 

Learning/Experience 

Figure  6 shows  that  the  workload  in 
each  group  is  greater  on  CAORF  than  at 
sea.  This  nearly  constant  offset  is 
attributed  to  a 1 ea rn i ng/ exper i ence 
effect  that  occurs  when  the  mate  ini- 
tially reports  on  the  CAORF  bridge. 

This  effect  is  similar  to  what  is  ex- 
pected to  occur  when  a mate  first  re- 
ports on  an  unfamiliar  ship.  He  has 
to  learn  the  instrumentation,  the  lo- 
cation of  the  controls,  and  the  setup 
of  radar;  he  has  to  become  familiar 
with  the  ship  operating  procedures, 
and  so  on. 

The  learning/experience  effect  has 
been  hypothesized  to  occur  in  two 
parts  - short-term  and  long-term.  The 
short-term  effect  occurs  at  the  begin- 
ning of  his  first  watch,  eventually 
settling  down  to  a more  normal  level 
of  activity.  Figure  7 shows  the  mate 
workload  with  the  short-term  learning/ 
experience  period  segmented.  The 
three  situation  categories  in  this  fig- 
ure are:  1)  learning/experience  - the 
first  hour  of  the  CAORF  watch,  which 
always  had  a low  contact  load;  2)  low 
contact  load  situations  that  occurred 
after  the  first  hour;  and,  3)  high 
contact  load  situations.  The  rela- 
tively high  workload  that  occurs  dur- 
ing the  short-term  learning/experience 
period  is  evident  from  Figure  7.  The 
CAORF  mates  are  as  active  during  this 
period  as  when  under  the  high  contact 
load  conditions.  The  impact  of  this 
short-term  1 ea rn i ng/ expe r i ence  period 
is  exemplified  by  the  workload  differ- 
ence between  this  group  and  the  low 
contact  load  group,  both  of  which  oc- 
curred under  low  contact  load  condi- 
tions. Removal  of  the  short-term 
1 ea rn i nq/ expe r i ence  effect  has  consid- 
erably reduced  the  difference  between 
CAORF  and  at-sea  workloads.  The  re- 
maining difference  is  attributed  pri- 


marily to  the  long-term  learninq/ex- 
perience  effect. 

Comparison  of  the  workloads  for  all 
tasks  with  those  for  radar  tasks  in 
Figure  7 reveals  that  radar  behavior 
was  not  overemphasized  by  mates  on 
CAORF.  The  higher  CAORF  radar  work- 
load is  in  proportion  to  the  higher 
CAORF  workload  for  all  tasks.  Hence, 
the  radar  workload  received  the  same 
relative  emphasis  on  CAORF  as  at  sea. 
The  absolute  differences  are  attrib- 
uted to  the  learning/experience  ef- 
f ec t on  all  tasks. 

The  behavior  of  one  CAORF  mate  was  in- 
vestigated with  regard  to  the  long- 
term learning/experience  effect.  This 
mate  stood  the  #2  Watch  (Matanilla 
Shoals)  twice,  the  two  times  separated 
by  three  months  during  which  he  had 
some  additional  experience  on  CAORF. 
Figure  8 shows  this  mate's  radar  work- 
load during  the  first  and  second  times 
he  stood  this  watch  (i.e.,  upper  and 
lower  curves, respec ti vel y)  . The  ra- 
dar workload  for  the  mate  at  sea  is 
also  plotted.  These  curves  show  a 
substantial  difference  in  the  radar 
workloads  between  the  mate's  two 
watches,  indicating  a long-term  learn- 
ing/experience effect.  Furthermore, 
the  CAORF  mate's  second  watch  radar 
workload  was  quite  similar  to  that 
which  occurred  at  sea  (i.e.,  almost 
no  radar  activity  until  the  contact 
load  increased  near  the  end  of  the 
watch).  These  data  should  be  cau- 
tiously interpreted  since  they  we  re 
from  only  one  mate  on  CAORF  and  one 
mate  at  sea.  Nevertheless,  they  sug- 
gest a long-term  learning/experience 
effect.  Additional  research  should 
be  conducted  at  sea  to  verify  the 
1 ea rn i ng/ exper i ence  effects  on  mate 
behavior  when  he  first  reports  on 
an  unfami liar  ship. 

Experimental  Effects 

The  initial  experiment  conducted  on 
CAORF  investigated  the  benefits  of 
electronic  aiding  on  ship  performance 
under  a variety  of  situation  condi- 
tions. Three  levels  of  electronic 
a i d i ng were  s tud i ed  : 1)  visual  only; 

2)  radar  and  visual;  and,  3)  collision 
avoidan.e  system  (CAS),  radar,  and 
visual.  The  CAS  condition  was  found 
to  result  in  superior  performance 
based  on  a variety  of  measures. 

One  of  the  major  purposes  of  this  val- 
idation study  was  to  investigate  the 
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validity  of  CAORF  experimental  find- 
ings. This  was  accomplished  by  com- 
paring experimental  effects  obtained 
from  CAORF  research  with  effects  ob- 
served in  the  at-sea  data.  An  impor- 
tant CAORF  research  finding  supported 
by  the  at-sea  data  was  that  CAS  equip- 
ped ships  attained  larger  ranges  at 
the  Closest  Point  of  Approach  (CPA) 
than  those  ships  equipped  with  radar 
only.  Figure  9 shows  the  high  degree 
of  similarity  in  the  ranges  at  CPA 
for  CAORF  and  at-sea  data  for  radar- 
only  and  CAS  equipped  ships.  Of 
greatest  importance,  however,  the 
at-sea  data  demonstrated  an  effect 
similar  to  that  obtained  from  research 
on  CAORF  - that  is,  a greater  range  at 
CPA  for  the  CAS  equipped  ships.  The 
experimental  effects  obtained  on  CAORF, 
therefore,  are  substantiated  by  the 
effects  observed  in  the  at-sea  data, 

SUMMARY 

The  findings  from  this  validation 
study  demonstrate  a degree  of  similar- 
ity between  mate  behavior  on  CAORF 
and  mate  behavior  at  sea.  The  mate's 
activity  level  on  CAORF  changed  in 
accordance  with  situation  conditions 
similar  to  behavior  that  occurred  at 
sea.  The  CAORF  mates  were  very  active, 
at  a level  equivalent  to  that  of  the 
most  difficult  situations  at  sea. 

This  generally  high  level  of  activity 
was  attributed  to  a learning/exper- 
ience effect  that  was  predominant 
when  the  mates  first  reported  on 
CAORF,  and  then  subsided  over  time. 

This  effect  was  similar  to  the  ex- 
pected behavior  of  mates  at  sea  when 
first  reporting  on  an  unfamiliar 
ship.  The  mate's  radar  behavior  on 
CAORF  was  also  found  to  be  similar  to 
that  occurring  at  sea,  a function  of 
the  changing  contact  load  conditions. 

Experimental  effects  obtained  in  the 
initial  CAORF  experiment  were  veri- 
fied by  the  at-sea  data.  These  vali- 
dation findings  are,  perhaps,  the 
most  important  since  they  directly 
support  the  validity  of  CAORF  re- 
search. 


The  CAORF  simulator  was  designed  pri- 
marily as  a research  tool.  Its  wide 
range  of  simulation,  control,  mon- 
itoring, and  analysis  capabilities 
make  it  an  excellent  training  device 
as  well.  Although  expensive,  operation 
of  CAORF  is  much  less  expensive  than 
the  operation  of  a ship  at  sea  for 
research  and  training  purposes,  as 
has  been  demonstrated  during  experi- 
ments for  the  port  of  Valdez,  Alaska. 
Other  factors,  such  as  the  control  of 
environmental  conditions  and  the  capa- 
bility to  train  in  failure  modes  of 
operation,  weigh  greatly  in  favor  of 
the  use  of  simulation.  The  acceptance 
of  CAORF  by  the  maritime  community  for 
research  and  training  clearly  demon- 
strates the  need  for  resource  conser- 
vation through  simulation.  The  CAORF 
validation  study  represents  a funda- 
mental step  in  verifying  the  feasi- 
bility of  simulation  for  solving  a 
variety  of  problems,  and  hence,  con- 
serving resources. 

The  results  of  this  validation  study 
support  the  quality  of  the  CAORF  sim- 
ulation and  the  resultant  empirical 
research  findings.  This  represents 
the  first  demonstration  of  the  be- 
havioral validity  of  a marine  simula- 
tion facility. 
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360-  NONPROGRAMMED  VISUAL  DISPLAY 


FRANK  J.  OHAREK 

Naval  Training  Equipment  Center 
Orlando,  Florida 


INTRODUCTION 

For  several  years  the  Naval  Training 
Equipment  Center  (NAVTRAEQUIPCEN) , it's 
numerous  contractors,  and  the  Air  Force  and 
it's  numerous  contractors  have  been  develop- 
ing wide-anqle  visual  systems  for  training. 
Iteny  approaches  have  been  tried  with  varying 
degrees  of  success.  These  approaches  can  be 
divided  into  two  broad  categories,  namely, 
single  channel  systems  and  multiple  channel 
systems.  Because  of  the  limited  information 
capacity  of  single  channel,  real-time  display 
systems;  the  limiting  resolution  of  such 
systems  is  quite  low  which  results  in  poor 
image  quality.  In  multiple  channel  systems, 
the  problems  become  those  of  color,  luminance, 
and  edge  matching  so  that  the  wide-angle  dis- 
play has  a continuous,  uninterrupted  appear- 
ance. Another  problem  for  multiple-channel 
systems  is  that  a wide-angle  probe  capable  of 
close  approach  to  model  boards  (on  the  order 
of  a few  millimeters)  is  not  available. 

In  the  Advanced  Simulation  Concepts  Lab 
at  NAVTRAEQUIPCEN,  we  have  been  trying  to 
develop  novel  wide-angle  visual  systems, 
that  perhaps  saner  people  might  not  attempt. 
The  display  system  to  be  discussed  today  is 
an  outgrowth  of  several  technology  advances 
of  industry  such  as  the  development  of  charge - 
coupled  devices  (CCD's),  the  development  of 
highly  synchronized  mechanical  laser  scanners, 
and  the  development  (in  our  own  lab)  of  the 
annular  projection  lens  shown  in  Figure  1. 

This  lens  consists  of  two  confocal  hyperbolic 
reflectors  to  eliminate  astigmatism  which  is 
usually  a plague  of  extreme  wide-angle  lenses 
and  a series  of  lens  groups  to  eliminate 
other  aberrations.  The  final  image  is  a 
plane,  annular  image  as  shown  in  Figure  2. 
Radial  lines  on  this  image  represent  vertical 
field  angles  and  concentric  circles  represent 
varying  horizontal  field  angles  at  a constant 
vertical  field  angle. 

What  I am  going  to  discuss  in  this 
paper  is  how  to  create  annular  images  with  a 
probe;  how  to  dissect  and  transmit  annular 
Images;  and  finally,  how  to  reconstruct  and 
project  annular  Images  to  give  a nonpro- 
grammed  360°  visual  display. 

The  applications  of  such  a system  in 
training  devices  are  numerous.  The  applica- 
tion that  is  currently  driving  the  system 
development  is  the  helicopter  nap-of-the-earth 
(NOE)  trainer.  In  NOE  flying,  the  helicopter 
flys  between  trees,  down  ravines,  etc.,  and 
the  pilot  chooses  his  own  path.  A system 


such  as  Disney's  360°  Monsanto  exhibit  would 
not  be  appropriate  because  the  flight  path 
would  be  prechosen  or  proqrattned.  Systems 
using  computer  generated  imagery  were  also 
eliminated  because  the  degree  of  detail  and 
fidelity  required  for  the  trainer  are  cur- 
rently somewhat  beyond  the  state  of  the  art. 
Thus,  the  current  application  dictated  a 
model  board,  probe,  projection  lens  type  of 
system. 

SYSTEM  APPROACH 

The  system  we  are  developing  is  shown 
in  Figure  3.  The  trainee  sits  in  a simulated 
cockpit  at  the  center  of  a spherical  screen. 
The  scene  that  he  views  is  projected  from 
the  projection  lens.  The  laser  assembly  is 
the  illumination  source.  The  probe  over 
the  model  board  flies  according  to  the  con- 
trols input  of  the  trainee,  so  that  if  the 
trainee  wants  to  fly  around  a certain  tree 
in  his  scene,  if  he  makes  the  proper  control 
adjustments,  the  probe  will  fly  around  that 
tree  on  the  model  board. 

Assuming  that  we  have  a probe  that  can 
create  an  annular  image  of  the  model  board, 
the  problem  is  how  do  we  transmit  the  annular 
image  to  the  projection  lens  for  projection 
onto  the  screen.  The  approach  taken  in  this 
system  is  a multiple  channel  approach  so 
that  we  can  transmit  adequate  information; 
but,  (and  here's  the  novelty)  the  channels 
are  interlaced  to  eliminate  color,  bright- 
ness  and  edge  matching  of  conventional 
multiple  channel  systems.  The  system  per- 
formance goals  are  shown  in  Figure  4.  The 
limits  shown  on  the  slide  are  not  theoretical 
limits  but  practical  limits  based  on  current 
designs.  That  is  why  probe  and  projection 
fields  of  view  and  resolutions  are  different. 
However,  we  feel  that  these  goals  are  ade- 
quate for  training. 

IMAGE  TRANSFER 

If  we  assume  that  we  have  a projection 
lens  that  can  project  an  annular  image  and 
that  we  have  a probe  lens  that  can  produce  an 
annular  image  from  a model  board,  then  the 
remaining  problem  is  to  transfer  the  image 
from  the  probe  to  the  projector.  If  we  use 
a single  channel  at  television  field  and 
frame  rates,  then  we  have  the  channel  match- 
ing problems.  So  the  approach  we  adopted 
was  a channel  interlace  approach  with  multiple 
channels;  this  eliminates  both  the  single 
channel  bandwidth  problem  and  the  multiple 
channel  matching  problems. 
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How  do  you  interlace  channels?  In  the 
160°  annular  imaqe  system  we  interlace  twelve 
video  channels.  Before  we  discuss  the  channel 
interlace  procedure,  it  would  be  better  to 
understand  how  one  channel  operates.  Fiqure 
5 shows  the  concept  of  the  imaqe  transfer 
system.  The  annular  image  from  the  model 
board  is  formed  by  the  probe.  It  is  relayed 
by  a relay  lens  to  a second  image  plane. 

A pechan  prism  in  the  relay  section  rotates 
causing  the  second  image  to  rotate  in  the 
direction  shown.  A linear  array  of  CCD's  is 
placed  in  a radial  direction  across  the 
image.  As  the  CCD  array  is  scanned,  we  get 
a vertical  field  scan.  At  the  end  of  a verti- 
cal scan,  the  image  has  rotated  to  a different 
horizontal  field  position  where  another 
vertical  scan  is  accomplished.  With  this 
arrangement,  a single  CCD  linear  array  scans 
out  the  whole  annular  image. 

In  the  projection  system  we  scan  a radial 
laser  line  in  a fixed  radial  position.  The 
line  is  relayed  to  a second  annular  image 
plane  with  an  intermediate  pechan  prism 
rotating  so  that  the  single  laser  line  is 
rotated  to  all  annular  image  positions.  The 
signal  from  the  linear  CCD  array  is  used 
to  modulate  the  radial  laser  line.  The 
counter  rotating  proj.ector  prism  is  synchro- 
nized to  the  probe  prism  so  that  the  image 
is  properly  positioned  in  the  screen  area. 
Thus,  a single  channel  can  produce  a complete 
360°  image  on  the  screen.  The  purpose  of 
additional  channels  is  to  reduce  the  scan 
rates,  rotation  rates,  and  modulation  band- 
widths  required  for  each  channel. 

In  order  to  get  multiple,  interlaced 
channels,  we  arrange  twelve  linear  arrays  of 
CCD's  in  almost  equally  spaced  radial  arrays. 
On  the  projector  side,  we  have  equivalent 
twelve  laser  scan  lines  arranged  radially. 

All  radial  arrays  are  positioned  as  shown  on 
the  interlace  mask  in  Figure  6.  Adjacent 
lines  are  staggered  slightly  by  three  arc 
minutes.  The  pechan  prism  is  rotated  at  a 
rate  so  that  the  image  rotates  six  arc  minutes 
for  every  vertical  scan  time.  At  that  rate, 
it  will  interlace  with  the  second  radial 
array  and  it  will  overlay  the  third  radial 
array.  Six  of  the  radial  lines  will  overlay 
each  other  (0°,  60°,  120°,  180°,  240°,  and 
270°);  the  other  six  will  also  overlay  each 
other  but  will  interlace  with  the  first  six. 
Since  each  of  the  twelve  urrays  constitutes 
a single  channel  (CCD,  modulator,  laser)  and 
each  channel  covers  the  whole  ■'mage,  then  we 
have  a channel  interlace  system  each  with 
one-twelveth  the  scan  rate  and  modulation 
bandwidth  required  of  a siigle  channel  tele- 
vision frame  rate  system. 

The  system  line  and  scan  rates  employed 
in  Our  twelve  channel  system  can  be  developed 
as  follows.  If  we  require  three  arc  minute 
line  spacing  In  a 360°  system,  then  we  must 


have  7,200  lincs/frame.  For  twelve  laser 
channels,  we  need  only  600  1 ines/channel / 
frame.  If  one  goes  through  the  math,  the 
line  scan  time  of  55  u.  sec.  and  the  mechani- 
cal laser  scanner  rate  of  750  RPS  for  a 24 
facet  mirror  can  be  calculated.  The  hori- 
zontal scan  rate  (prism  rotation  rate)  can 
be  calculated  knowing  that  the  image  must 
rotate  six  arc  minutes  in  the  time  of  one 
line-scan.  This  will  automatically  produce 
a 2:1  interlace  and  give  an  equivalent  sixty 
fields  per  second. 

SUBSYSTEMS  AND  COMPONENTS 

The  projector  arrangement.  Figure  7, 
shows  how  all  twelve  laser  channels  are 
scanned  with  one  twenty-four  facet  laser 
scanner  operating  at  45,000  PPM.  Only  two  of 
the  twelve  lasers  whic"!  are  arranged  radially 
around  the  scanner  are  shown  in  this  figure. 
The  optics  between  the  scanner  and  the  first 
annular  image  plane  convert  the  targential 
laser  scan  patterns  into  twelve  radial  scan 
patterns.  The  twelve  stationary  laser  scans 
are  then  rotated  and  relayed  to  fill  the 
annular  image  plane  of  the  projection  lens 
which  then  projects  the  pattern  onto  the 
spherical  screen. 

The  artists  concept  of  the  probe 
arrangement  is  shown  in  Figure  8.  The 
twelve-sided  pyramidal  mirror  at  the  top 
bends  the  optical  path  for  each  CCD  array  so 
that  they  can  be  physically  arranged  in  a 
cylinder  around  the  optical  axis  of  the 
probe.  Again,  we  have  the  pattern  of  one 
annular  image  plane  being  relayed  into  a 
second  annular  imaqe  plane  with  the  rotating 
pechan  prism  between.  The  annular  probe 
lens,  in  particular  the  front  element,  is  a 
new  optical  system  which  is  currently  under 
design.  The  first  order  analysis  indicates 
that  we  can  get  to  within  two  millimeters  of 
the  model  board  with  the  probe  entrance 
pupil.  The  design  goal  is  for  a diffraction 
limited  F/9  system  covering  the  spectral 
bandwidth  of  the  CCD's.  Considering  the 
vertical  scan  rates  and  thus  the  integration 
times  available,  it  is  necessary  to  go  to  low 
light  level  devices  such  as  CCD's.  It  is 
questionable  whether  an  F/9  system  of  this 
type  would  have  been  feasible  without  low 
light  level  CCD's. 

CURRENT  STATUS 

The  system  and  component  designs  are 
all  complete  with  the  exception  of  the  probe 
lens.  The  45,000  RPM  laser  scanner  has 
been  designed  and  is  being  fabricated  by  the 
Ampex  Corporation  in  Redwood  City.  The 
prism  rotation  motors  are  being  fabricated 
by  Baldwin  Electronics  in  Little  Rock.  The 
projection  lens  is  (inder  contract  to  Space 
Optics  Research  Labs  in  Chelmsford.  Other 
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cxinponents  are  being  bought  and  assembled 
in-house.  The  final  assembly  and  demonstra- 
tion is  scheduled  for  August  1978  in  Orlando. 

COLOR 

The  system  that  has  been  described  so 
far  is  a monochrome  system  which  will  be  used 
to  demonstrate  feasibility.  A study  has  been 
performed  to  investigate  the  problems  in 
going  to  a full  color  system.  We  are  cur- 
rently using  twelve  argon  lasers  for  the 
twelve  channels;  the  study  indicates  that 
if  we  make  four  channels  krypton  lasers,  then 
we  can  project  full  color.  Since  each  channel 
covers  a 30-degree  sector  on  the  screen  be- 
fore the  next  channel  covers  the  same  sector, 
we  will  have  a field  seguential  color  system. 
By  increasing  the  prism  rotation  rate  and,  if 
higher  resolution  is  needed,  the  laser  scan 
rate,  it  is  possible  to  eliminate  color 
flicker  in  the  system. 

Another  modification  that  must  be  made  to 
complete  the  transformation  to  color  is  to 
lut  appropriate  filters  over  the  CCD's.... 


Because  of  the  spectral  band  of  the  CCD's 
(500-1000  nm),  it  will  probably  be  necessary 
to  go  to  a false  color  system  on  the  model 
board. 

CONCLUSIOH 

This  paper  has  presented  a design  ap- 
proach to  a large,  spherical  screen  laser 
display  system  utilizing  a probe  and  model 
board  for  input  imagery.  Paper  studies  and 
designs  have  verified  the  feasibility  of 
this  complex  360°  Nonprogrartmed  Visual 
Display,  but  because  of  it's  complexity  and 
the  tight  tolerances  (which  I have  not 
covered  in  this  paper)  on  component  and 
system  performance,  it  was  decided  to  have  a 
hardware  feasibility  demonstration.  The 
features  of  the  system  which  nonbelievers 
are  most  skeptical  about  are  the  scanner 
synchronization  with  the  prism  motors  and 
CCD's,  the  complexity  of  optical  alignment, 
the  optical  probe  performance  and  the  ability 
to  have  relatively  trouble  free  operation. 

The  system  fabrication  is  underway  with  a 
scheduled  demonstration  in  August  of  78, 


figure  I.  Annular  Projection  Lens 


LASEK  PATH  LAStP 


fiyure  3.  System  Concept  (360°  Nonprog  rammed  Visual  Display) 


PROJECTOR 

• FIELD  OF  VIEW 

360°x  90° 

• RESOLUTION 

6 ARC  MIN 

• LUMINANCE 

10  FT  LAMBERTS 

• DARK  FIELD 

1 MH7-0.1  FT  LAMUERTS 
10  Mtl7-0.25  FT  LAMBERTS 


PROBE 

• FIELD  OF  VIEW  .360°  x 60° 

• RESOLUTION 3 ARC  MIN 

• F/# 9 

• PUPIL  DIAMETER . . 1 MM 

• ENTRANCE  PUPIL  DISTANCE  2 MM 


Figure  4.  Performance  Goals 


315 


RAOIAl  SCAN 


FROM  MOOfL  BOARD 


TO  SCREEN 


Figure  5.  Image  Transfer  System 


INTERLACE  METHOD: 

1.  IMAGE  ROTATION  RATE  ROTATES  SCAN  LINE  6 ARC  MIN 
DURING  ONE  RADIAL  SCAN  (VERTICAL  SCAN) 

2.  SCAN  LINES  0°,  60°,  120°,  etc  WILL  OVERLAV 

3.  SCAN  LINES  30°-3' , 90°-3' , etc  WILL  OVERLAY 

4.  ALTERNATE  SCAN  LINES  WILL  INTERLACE 


Figure  6.  Interlace  Mask 


Figure  8,  Probe  Arrangement 
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DESIGNING  SIMULATORS  TOR  PRACTICALITY 


UR.  CHRISS  CLARK  and  DR.  JAMES  A.  GARDNER 
Honeywell  Inc. 


INTRODUCTION 

Exploiting  Simulation  in  Maintenance  Training] 

The  trend.  There  is  a growing  trend  to  exploit 
the  potential  henefits  of  simulation  technol- 
ogy in  the  maintenance  training  environment. 

The  Ail  Force,  for  example,  is  currently  con- 
tracting for  a simulator  system  designed  to 
train  organizational -level  (0-level)  mainten- 
ance procedures  for  ten  subsystems  of  the  E-IG 
aircra^^t.  Procurement  of  simulators  for  train- 
ing F-16's  intermediate -level  (I -level)  main- 
tenance procedures  is  under  advisement.  Cur- 
rent plans  call  for  using  simulators  to  train 
E-TA  and  selected  F-IS  maintenance  as  well. 
These  procurements  signify  a fundamental 
change  in  the  philosophy  of  maintenance  train- 
ing, which  has  relied  almost  exclusively  to 
date  on  actual  equipment  trainers. 

The  incentives.  The  principal  incentives  for 
this  revised  approach  to  maintenance  training 
are  expressed  concerns  over  the  high-dnllar 
costs  of  training  and  combat  readiness,  coin- 
cident with  increasing  pressures  to  curt)  de- 
fense spending.  Approximately  $12.6  bil- 
lion are  consumed  annually  by  the  military 
for  direct  training  costs.  The  Offices  of 
Management  and  Budget,  and  Secretary  of 
Defense  have  issued  directives  requiring  that 
all  trainers  and  simulators  be  cost- just i fied 
prior  to  funding(l).  Air  Force  Systems 
Lommand  has  likewise  placed  renewed  emphasis 
on  development  and  application  of  life-cycle 
cost  technigues  within  all  technology  areas(2). 

One  significant  impact  on  training  costs  is 
the  number  of  trained  personnel  required  to 
meet  field  demands.  The  Army,  for  example, 
has  expressed  interest  in  reducing  mainte- 
nance personnel  by  seven  to  ten  percent.  This 
is  a reasonable  goal,  however,  only  if  the 
remaining,  more  limited  maintenance  force  is 
better  trained  to  compensate  for  the  reduction. 
Unfortunately,  evidence  suggests  that  in  many 
instances  effectiveness  of  current  training 
is  far  from  adequate  even  for  the  existing 
maintenance  forces. 

An  increased  emphasis  on  "hands-on"  practice 
of  maintenance  procedures  (c.g.,  the  Navy's 
Technical  Hands-On  Training  System(3))  is  in- 
tended to  improve  training  effectiveness.  In 
general,  however,  hands-on  practice  is  severely 
limited  with  actual  equipment  trainers. 


Simulators,  on  the  other  hand,  permit  the 
practice  of  a full  range  of  test  procedures, 
including  those  that  would  be  dangerous  or 
expensive  to  practice  on  actual  equipment. 

Ass«sinj  Practical  i ty 

The  que^tijan.  A number  of  experimental  pro- 
grams have  demonstrated  the  feasibility  of 
using  simulators  as  alternatives  to  actual 
equipment  trainers  for  training  maintenance 
personnel.  The  feasibility  of  applying  simula- 
tion to  I-level  maintenance  training  was  first 
demonstrated  by  Honeywell  as  part  of  an  NAVTRA- 
EQUIPCEN-sponsored  program  to  simulate  the  ALQ- 
100  electronic  warfare  set  and  associated  test 
stations. (4)  The  feasibility  of  simulating 
complex  electronic  maintenance  equipment  is  no 
longer  in  doubt.  The  question  becomes:  are 
simulators  practical  alternatives  to  actual 
equipment  for  training  purposes  ? This  is  the 
issue  suggested  by  the  conference  theme, 
"Resource  Conservation  Through  Simulation." 

Practical  i^  defined.  Simulated  maintenance 
equipment  becomes  a practical  alternative  when 
the  associated  life-cycle  costs  (LCC)  are  less 
than  those  of  corresponding  actual  equipment 
trainers.  This  reduction  can  be  effected 
primarily  by  substantial  reductions  in  both 
procurement  costs  and  the  long-term  mainte- 
nance costs  for  simulated  equipment.  In  addi- 
tion, the  use  of  simulated  equipment  as  a 
training  device  must  at  least  maintain  and 
preferably  improve  upon  the  level  of  training 
effectiveness  achieved  with  actual  equipment. 
Improved  training  effectiveness  will  he  re- 
flected in  further  LCC  reductions. 

Related  research.  A major  on-going  Air  Force 
research  program(5)  is  addressing  tiie  practi- 
cality issue  with  respect  to  I-level  electronic 
maintenance  training.  The  current  program  phase 
focuses  on  design,  fabrication,  and  testing  of 
a simulator-based  system  to  provide  hands-on 
training  of  Level -3  Apprentices  to  maintain 
the  6883  Converter/Flight  Control  Test  Station 
(in  support  of  the  F-lllD  aircraft)  and  asso- 
ciated Line  Replaceable  Units  (LRUs).  The 
system  incorporates  simulations  of  the  6883 
Test  Station,  four  associated  adapters,  and 
three  LRUs.  A later  program  phase  will  include 
a comparative  evaluation  of  current  versus 
simulator-based  6883  training.  Comparisons 


will  iiicliiclr  irr  .itirtlv^i''’  'IS  wi'11  .)s  tr'iiiiiinq 
(>'*('!  ♦ i vt'tK’ss  f'vd  1 iia  t i on', . 
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tify  some  o*  thn  ntaior  tactors  inf  1 lioncinij 
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'ftaticn  'r.iinini)  nnvirnnmnnt  --  factor',  that 
Ca'i  ('f*ni  t rnsnurcn  cotisnrvat  ton . Tills  rn- 
(juirns  an  tnclnrstami  i nq  of  what  simulatnr- 
f'asod  traininq  systoins  arn  ,tnf1  what  rosourcf 
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traininq  sy  tt;ms  must  focus  On  tho  iflontifiod 
soitrcos  of  lovcraqo  in  pxfstinq  traininq 
systems . 

Numerous  references  are  made  to  the  Air 
rorc(>'s  6H83  program  to  illustrate  how 
resource  conseryation  can  tie  considered  in 
the  design  of  a traininq  system.  The  6883 
Test  Station  is  an  appropriate  vehicle  for 
demonstration  because  it  represents  a general 
class  of  very  expensive,  complex,  electronic 
test  stations  commonly  found  in  I-level  main- 
tenance shops  and  currently  used  as  actual 
equipment  trainers  as  well.  Therefore,  many 
considerations  made  with  regard  to  providing 
simulator-based  traininq  for  the  6883  can 
generalize  with  reasonable  accuracy  to  a 
large  number  of  similar  devices. 

simulator-based  training  systems 

Definitions  of  simulation  and  simulators 
abound(6).  Nonetheless,  certain  general 
features  characterize  nearly  all  simulator- 
based  training  systems.  First,  simulator- 
based  training  systems  incorporate  devices 
that  duplicate,  in  varying  degree,  the  ap- 
pearance and  operation  of  selected  actual 
equipment.  The  resultant  "simulators"  range 
in  complexity  from  simplistic  cardboard  mock- 
ups  to  the  very  sophisticated  flight  simu- 
lators used  in  pilot  traininq.  The  essential 
feature  is  that  the  simulators  provide 
’sufficient"  realism:  1)  to  evoke  and  permit 
practice  of  specified  job-related  tasks,  and 
2)  enhance  transfer  of  the  learned  skills/ 
knowledge  to  real  world  job  environments. 

In  the  design  of  all  simulators,  certain 
aspects  of  the  actual  equipment  are  deliber- 
ately omitted;  that  is,  the  simulators  are 
characterized  by  less  than  100  engineering 
fidelity.  The  simulators  becotrie  traininq 
devices  when  these  omissions  are  based  on 
careful  identifications  of  how  the  devices 
are  to  be  used  in  the  traininq  environment  -- 
wfiat  persons  with  wtiat  entry-level  skills/ 
knowledge  are  to  be  trained  to  perform  what 
set  of  tasks  to  what  level  of  proficiency 
under  what  conditions? 

Second,  simulator-based  traininq  systems  may 
incorporate  supporting  instructional  features  -- 
trainer-unique  features  and  capa()i  1 i ties  not 


inh(>rent  to  the  actual  equipment.  These 
features  could  include  carefully  controlled 
learning  situations,  step-tiy-ctei]  monitorinq 
of  trainee  action',,  [lerformance  feedliack, 
automated  instruction,  and  well  desiqned 
student  and/or  in'.frurtor  station  consoles. 
Aqain,  however,  ttie  re<|uiremenf  for  thi-se 
various  adjunct  features  must  f<e  tiased  on 
a clear  specification  of  infendf'd  simulator 
trainer  use. 

Third,  within  the  context  of  flot.e/wel  1 ' s 
Automated  Electronic  Maintenance  Training 
(AEMT)  concept,  simulator-based  traininq 
systems  are  closed- loop  (i.e.,  computer- 
driven  and  computer-sensed)  systems  desiqned 
primarily  to  provide  hands-on  practice  of 
required  job  skills.  Not  only  does  the 
computer  control  the  training  environment 
{e.q.,  by  simulating  a carefully  selected 
set  of  maintenance  problems  to  which  the 
trainee  must  apply  relevant  skills  and  knowl- 
edge), but  it  also  monitors  the  trainee's 
step-by-step  actions,  compares  these  actions 
with  prescribed  procedures,  and  informs  both 
the  trainee  and  his  instructor  concerning 
the  trainee's  performance.  This  feedback 
is  intended  primarily  as  a learning  aid  and 
only  secondarily  as  data  for  student  records. 
The  specific  content,  format,  and  frequency 
of  that  feedback  vary  in  accordance  with  this 
aim. 

TRAINING  DEMANDS  ON  RESOURCES 

The  costs  of  current  maintenance  traininq 
systems  fall  into  two  general  categories: 
personnel  (student,  instructor,  and  support) 
and  equipment  (procurement  and  support).  Of 
these  two,  personnel  costs  account  for  the 
major  portion,  although  tfie  degree  of  savings 
leverage  associated  with  that  category  varies 
with  the  particular  system. 

Eor  example,  personnel  costs  vary  from 
approximately  half  of  the  total  system  costs 
in  the  case  of  the  A-7  Heads-Up  Display  (HUD) 
system  (7),  to  97  percent  of  total  costs 
in  the  case  of  the  Navy's  Basic  Electronics 
and  Electricity  (BESE)  Program  (8).  Because 
the  HUD  and  ALQ-lOO  Electronic  Warfare  systems 
are  relatively  equipment-intensive  systems 
with  low  student  flows,  comparable  savings 
can  be  achieved  in  both  equipment  and  personnel 
categories.  In  stark  contrast,  the  BEXE  pro- 
gram is  extremely  personnel-intensive,  input- 
ting over  7000  studrnits  per  year,  per  traininq 
site.  Althougii  the  actual  training  equipment 
in  the  BE^E  course  may  be  cost  effectively 
simulated,  tiie  real  leverage  rests  in  reducing 
personnel  costs,  especially  students.  There- 
fore, any  BEST  simulation  system  must  maxi- 
mize traininq  effectiveness  to  be  a practical 
alternative. 
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.1(1(11  Kfllion  of  s iniiil  .1 1 ion  to  m.i  i ntondiice 
fi-dininq  could  im[i,ict  tiMininq-roldtod  pnr- 
sonrinl  costs  in  a variety  of  ways,  lor  nx- 
aii()lr>,  simulator-based  traininq  systems  hayn 
the  (intent  ial  to: 

• Improve  the  instructor/student  ratio, 
thereby  reducinq  instructor  costs. 

• Reduce  student  on-board  time,  thereby 
reducinq  student  costs. 

• Reduce  required  maintenance  force  for 
traininq  equipment,  thereby  reducinq 
su(i|inrt  costs. 

• Minimize  personnel  required  to  incor- 
porate curriculum  and/or  enqineerinq 
changes,  again  reducinq  siqiport  costs. 

0 Reduce  required  number  of  field  main- 
tenance personnel,  therehy  reducinq 
the  required  traininq  throughput. 

These  areas  of  (lotential  sayings  are  addressed 
in  subsequent  sections  of  this  paper. 

DESIGNING  FOR  RESOURCE  CONSERVATION 

The  tey  to  resource  conseryation  through  sim- 
ulation is  careful  traininq  system  design. 

To  be  effectiye,  this  design  process  must  be 
guided  by  multiple  considerations,  including 
the  following: 

0 Meeting  training  objectiyes 

0 Meeting  without  exceeding  required 

functional  capabilities 

0 User  acceptance 

0 Improyed  traininq  ef fecti yeness 

0 Traininq  system  supportabi 1 i ty 

Howeyer,  the  first  decision  to  make  regarding 
the  application  of  simulation  to  maintenance 
traininq  is  when  not  to  simulate.  Simulator- 
based  systems  cannot  be  assumed  a priori  to 
be  the  most  practical  approach  to  meeting  the 
traininq  need.  Factors  to  be  considered  in- 
clude: the  projected  student  pipeline,  the 
ayailability  of  inexpensive  alternative  train- 
inq media,  {e.q.,  sound-slides,  video  tape, 
movies,  cardboard  mockups),  number  of  required 
training  units,  current  traininq  deficiencies, 
user  acceptance  of  simulation,  and  the  state- 
of-the-art  in  simulation  technology.  Indeed  it 
is  quite  possible  that  no  single  approach 
is  Sufficient  to  meet  the  total  traininq  re- 
quirement; some  combination  of  operational, 
simulated,  and/or  stimulated  equipment  together 
with  traditional  classroom  approaches  may  pro- 
vide the  most  appropriate  training  environment. 

There  is  recognition  of  the  fact  that  simula- 
tion should  be  implemented  selectively.  The 
Air  Force  Human  Resources  Laboratory  (AFHRL) 
has  recently  awarded  a contract  to  develop 


and  a()()ly  a technique  to  identify  areas  of 
technical  traininq  within  Air  Traininq  Command 
where  high  payoffs  can  result  through  use  of 
simulation.  This  techniques  is  to  be  appli- 
cable across  skills  levels  and  will  not  be 
limited  to  avionics  a()()l  ications . The  Army 
has  liiewise  publicized  its  intent  to 
sponsor  a study  to  identify  the  areas  of 
maintenance  traininq  for  which  reduced 
fidelity  trainers  can  be  cost-effectively 
sulistituted  for  standard,  operational  equip- 
ment currently  used  as  trainers.  These 
identifications  are  to  be  made  on  the  basis 
of  training  level  (institutional  or  unit), 
type  and/or  specialty  (track  vehicles,  wheel 
vehicles,  aviation,  electronics),  and  skill 
(motor,  cognitive  nr  combination). 

Design  to  Meet  Training  Objectives 

The  crucial  first  step  in  the  design  of  any 
simulator-based  training  system  is  a front- 
end  analysis.  It  is  conducted  to  determine 
the  training  features  to  be  incorporated 
not  only  in  the  simulator  traininq  device 
itself,  but  in  the  total  traininq  system. 

The  resultant  functional  specification  guides 
the  subsequent  detailed  design  and  determines 
in  large  part  the  ultimate  effectiveness  of 
the  device,  thereby  impacting  both  equipment 
and  personnel  costs.  A recent  AFHRL-sponsored 
program  recommended  and  documented  a process 
for  the  design  of  trainers  based  on  behavioral 
information  (9).  The  identifiable  products 
of  the  front-end  analysis  may  include: 

0 A listing  of  tasks/ski  1 1 s/knowledqes 
to  be  trained.  These  constitute  train- 
inq requirements  and  are  specific  re- 
flections of  the  fundamental  purpose 
of  any  training  system:  to  evoke 
prescribed  changes  in  human  behavior. 
They  are  a function  of  the  ultimate 
behavioral  objectives  for  the  trainees 
upon  completion  of  traininq  and  the 
level  of  sk i 1 1 s/knowledqe  possessed 
by  trainees  upon  entering  traininq. 

0 An  established  set  of  traininq  priori- 
ties. For  example,  a conrion  goal  in 
maintenance  traininq  is  to  place  pri- 
mary emphasis  on  detection  of  faults 
and  isolation  of  their  sources  and 
to  place  secondary  emphasis  on  per- 
forming the  appropriate  remove-and- 
replace  (RAR)  task.  A few  representa- 
tive repair  actions  are  usually  re- 
quired; in  cases  where  the  trainee  is 
not  asked  to  perform  the  RRR  task, 
he  is  nonetheless  asked  to  indicate 
what  the  appropriate  repair  action 
would  be,  given  the  simulated  fault. 

0 Documents  that  specify  the  functional 
requirements  of  the  related  hardware, 
software,  and  courseware.  These 
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ilociinients  .ire  rptt'rrpd  to  .is  func- 
tional or  port ormanco  specifications, 
fthile  the  training  requirements  and 
priorities  ere  statements  related  to 
the  trainee's  prescribed  performance 
during  training,  the  functional  speci- 
'ication  establishes  the  capabilities 
and  perf^ormances  required  of  the  simu- 
lator, or  ithei  training  device,  and 
of  the  system  of  which  it  is  a part. 

Although  the  functional  specification  does 
not  contain  the  detailed  design  information 
such  as  would  be  required  to  cost  and  fab- 
ricate the  simulator  system  (e.q.,  drawings, 
diagrams,  theory  of  operation,  parts  list), 
it  does  constrain  the  detailed  design. 


The  development  of  training  requirements, 
priorities,  and  functional  specifications 
requires  that  one  address  a number  of  critical 
questions.  Typical  questions  include  the 
following: 

• .Jhat  is  the  intended  scope  of  the  train- 
ing system  and  how  is  the  simulator 
training  device  to  be  used  within  that 
system?  (Jill  the  simulator  be  the 

sole  or  even  primary  training  equip- 
ment? 

• what  is  the  entering  slf i 1 1 /knowledge 
level  of  the  target  trainee  popula- 
tion? To  what  level  of  expertise  are 
they  to  be  trained? 

• What  are  the  deficiencies  in  existing 
training  and  what  accounts  for  them? 

• What  is  the  set  of  on-the-job  proce- 
duros  that  an  individual  of  the 
designated  exit-level  skill  is  expected 
to  execute?  These  prescribed  proce- 
dures are  a function  of  the  accepted 
maintenance  philosophy.  The  identified 
set  will  likely  reflect  both  normal 

and  degraded  modes  of  operation.  In 
the  case  of  developing  simulator-based 
maintenance  training  systems,  signifi- 
cant effort  is  directed  towards  select- 
ing a representative  subset  of  realistic 
malfunctioning  conditions  to  which  the 
trainee  is  exposed  so  that  he  can  prac- 
tice fault  detection,  isolation,  and 
troubleshooting  techniques. 

The  identified  maintenance  procedures  are 
further  described  in  terms  of  specific  actions 
ff.g.,  place  400  CPS  and  60  CPS  circuit 
breakers  to  ON  position),  associated  man/ 
equipment  interfaces,  and  relevant  cues 
(e.g.,  displays  and  indicator  lights).  These 
data  are  then  cross-referenced  with  fea- 
tures of  the  actual  equipment  to  identify  a 


candidate  set  of  equipment  features  and  visual/ 
fijnctional  fidelity  levels  to  be  reflected  in 
the  simulator  design.  Final  selection  of  func- 
tional capabilities  is  based  on  such  consider- 
ations as  difficulty/importance  of  training 
the  associated  prncedure(s ) , alternate  train- 
ing forums  for  the  procedure(s)  (including  on- 
the-inb  training),  cost  considerations,  and 
user  biases. 

In  the  case  of  selecting  functional  capabili- 
ties for  the  6883  Simulator  System,  decisions 
reflect  the  preceding  considerations  plus  an 
underlying  philosophy  of  training  by  repre- 
sentative example.  These  selection  criteria 
are  perhaps  best  illustrated  by  the  Data  Trans- 
fer and  Control  (OATAC)  drawer  and  power  supply 
drawers.  The  DATAC  (Figure  1)  was  selected 
for  in-depth  simulation  because  it  is  central 
to  a variety  of  maintenance  procedures.  It  is 
the  principal  technician  interface  through 
which  automatic  test  requests  are  initiated, 
test  modes  are  changed,  and  test  results  are 
displayed.  Knowledge  of  its  functions/opera- 
tion is  essential  to  operation  of  the  entire 
test  station.  The  training-by-example  phil- 
osophy is  reflected  in  simulation  of  the  DATAC 
drawer  interior.  Although  the  hinged  card 
frame  assembly  contains  a full  set  of  56 
simulated  printed  circuit  cards  (Figure  2), 
only  4 are  removable  and  sensed  by  the 
computer.  The  remove-and-replace  procedure 
is  identical  for  any  one  of  the  56  cards 
and,  therefore,  can  be  sufficiently  well 
trained  on  a limited  number  of  such  cards. 


Figure  1.  Simulated  DATAC  Drawer, 
Side  View 
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Figure  2.  Simulated  DATAC  Drawer 
Interior,  Top  View 

For  similar  reasons,  only  a single  power  sup- 
ply drawer  is  simulated  internally,  although 
the  6883  has  several  power  supplies.  Main- 
tenance procedures,  simulation  techniques, 
and  the  sMlls  and  knowledge  required  for 
troubleshooting  are  conmon  among  most  power 
supply  circuits  in  the  6883.  This  simulation 
philosophy  is  reflected  throughout  the  func- 
tional design  of  the  test  station  and  LRU 
simulations.  Figure  3 depicts  the  resulting 
variation  in  fidelity  across  the  panels  of 
the  test  station  simulator.  The  6883  Simu- 
lator consists  of  28  metal  photo  panels,  3 
pull-out  drawers  with  simulated  interiors, 
and  an  unmodified  GFE  oscilloscope,  arranged 
in  the  appropriate  A-bay  configuration. 

Selected  front  panels  are  represented  com- 
pletely with  metal  photos.  Others  are  sim- 
ulated using  metal  photos  plus  appropriately 
positioned  functional  components. 

By  making  the  types  of  tradeoffs  just  descrilied, 
the  6883  Simulator  Systeni  permits  the  trainee 
to  practice  the  range  of  maintenance  procedures 
that  a 3-Level  Apprentice  must  perform,  with- 
out requiring  unnecessary,  costly  simulator 
features . 


Design  to  Meet,  Not  F xceed  Requ i red  Capabilities 

Several  alternative  detailed  designs  may  sat- 
isfy the  functional  specification;  the  soeci- 
fication  itself  does  not  contain  any  explicit 
design  decisions  or  choices  amono  alterna- 
tive design  approaches.  For  example,  the  6883 
functional  specification  requires  that  the 
system  permit  the  trainee  ‘o  adiust  a d(>signa- 
ted  potentiometer  within  specified  tolerance 
limits;  the  adjustment  should  he  reflected 
on  a corresponding  meter.  The  detailed 
design  of  the  simulated  potentiometer  (e.g., 
how  it  is  sensed),  the  simulated  meter  (e.g., 
how  it  is  driven),  and  related  performance- 
monitoring software  are  not  specified,  although 
they  are  constrained  by  the  functional  re- 
quirements. In  this  case,  the  potentio- 
meter and  meter  representations  must  bear 
sufficient  visual  similarity  (visual  fidelity) 
to  and  must  also  appear  to  function  like 
(functional  fidelity)  their  operational  coun- 
terparts, with  regard  to  the  specified  adjust- 
ment task.  Moreover,  the  system  must  be 
able  to  sense  the  trainee's  adjustment  and 
to  compare  that  adjustment  with  the  pre- 
scribed procedure.  Dow  these  functions  are 
to  be  accomplished  is  not  prescribed  in  the 
functional  specification. 

Caution  must  be  exercised  to  avoid  over 
designing  the  simulator  system.  To  develop 
an  engineering  design  for  a system  that 
exceeds  the  required  functional  capabilities 
merely  increases  cost  without  providing  a 
corresponding  increase  in  training  effec- 
tiveness. For  example,  unnecessarily  costly 
displays  may  be  designed  that  provide  rise 
times,  resolution,  or  dynamic  capabilities 
far  beyond  what  is  required  for  a simple 
GO  or  NO  GO  maintenance  status  check. 

Carefully  prepared  functional  specifications 
can  often  lead  to  dramatic  reductions  in 
the  required  fidelity  of  simulated  controls 
and  displays  without  negatively  impacting 
training  effectiveness.  For  example,  a 
front-end  analysis  of  the  F-4N  O-level 
Visual  Target  Acquisition  System  (VTAS)  radar 
training  requirement  indicated  that  students 
already  had  received  extensive  experience 
with  radar  display  interpretation  prior  to 
their  entry  to  the  VTAS  course  (10).  It 
was  only  necessary  for  the  students  to 
detect  the  presence  or  absence  of  certain 
dynamic  radar  modes.  Therefore,  a simulation 
of  these  radar  modes  was  simply  constructed 
from  a series  of  lighted  segments  which  com- 
bine through  computer  control  to  create  the 
appropriate  display.  Ry  properly  sequencing 
the  lighted  segments,  the  computer  soft- 
ware duplicates  the  various  dynamic,  sweeping 
radar  displays  normally  seen  during  VTAS  check- 
out. 
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Figure  3.  Panel -by-Panel  Summary  of  Simulation 
Levels  Required  Across  Test  Station 


Through  a clear  identification  of  the  fea-  the  lesson  once  he  has  made  the*  specified 

tures  necessary  for  effective  training,  corrective  response.  This  procedural  soft- 

similar  cost-effective  detailed  design  ware  design  approach  provides  a low-cost 

decisions  can  be  made  for  such  diverse  solution  to  a range  of  maintenance  technician 

topics  as  input/output  response  speeds,  tasks  having  clearly  defined  actions  and  equip- 

control  resolution,  meter  motion,  and  wave-  ment  responses, 

form  f idel ity. 

In  contrast,  some  functional  specifications  may 
Overdesign  is  a potential  pitfall  in  soft-  require  the  simulation  to  model  the  actual 

ware  design  as  well.  Before  any  detailed  equipment  operation.  This  modelled  software 

software  design  is  initiated,  it  must  first  design  approach  requires  the  deveTopment  of  a 

be  determined  if  the  functional  specifica-  polynomial  mathematical  equation  of  each  instru- 

tion  requires  primarily  procedural  or  mod-  ment  as  well  as  for  the  overall  system  control 

elled  software.  For  many  maintenance  training  and  display  interactions.  The  student  may  set 

tasks,  it  is  only  necessary  to  duplicate  controls  and  make  adjustments  in  any  order  he 

display-control  interactions  and  to  monitor  chooses,  and  the  equipment  will  respond  appro- 

trainee  performance  for  specific  step-by-  priately.  Student  performance  measurement  in 

step  procedures  defined  in  the  system  main-  a tirodelled  system  is  correspondingly  more 

tenance  manual.  Should  the  student  make  complex  due  to  the  more  ambiguous  performance 

an  error  such  as  setting  an  incorrect  switch  criteria.  The  greater  complexity  of  modelling 

or  skipping  a procedural  step,  the  computer  software  is  reflected  in  greater  development 

will  halt  the  lesson,  provide  the  appropri-  and  modification  cost, 

ate  feedback,  direct  the  student  to  correct 
his  error,  and  allow  him  to  proceed  with 


324 


Llcsiijii  tor  U‘.t>r  A(,cf*[)t,inf(‘ 

*h(>  for  t.iUnq  t he  imv.f  im;iH  s t,  i c 

whii  h s.i  t i f it's  ('xiilicit. 
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•list  * fmiH'i'cil  sliijtit.lv  liy  (.ntKctti  for 
isi'f  .ictPl't.inci'.  Tfrul  i t i on.)  1 1 y , flirjhi  sim- 
uliitnrs  iicivt'  tifcn  r tidt-.it t('f i /pd  by  pxtrpinply 
hitih  piKji nppr in'i  fidi'lity  --  tu  t.hp  luiint 
tbrtt  tbpy  could  he  cousidpred  withniif. 

winqs  --  ,iitd  tbp  cost  of  such  sinmlators 
sompl imps  pxcppd  th.it  of  thp  oppfflt.iona  1 aif- 
Cf.ift  f hpmspl  yps . This  can  be  atfrihutod  t.n 
two  tna jor  factors:  1)  limited  data  concern inq 
top  tpatiires  of  the  aircraft  systt'ni  that  are 
required  to  tram  the  mission,  and  2)  the 
demands  of  users  for  a traininq  device  that 
feels  liie,  looks  like,  smells  like..." 
the  real  thmq.  Thp  user's  conviction  is 
frequently  that  the  actual  equipment  is  the 
best  traininq  environment;  simulators  somehow 
repri'St'ot  a deqraded  traininq  environment,  but 
are  accepted"  because  they  become  the  only 
reasonable  alternative  in  liqht  of  qovern- 
ment  edicts  to  reduce  costs. 

The  problem  of  overcominq  the  user  community's 
resistance  to  simulator-based  traininq 
where  actual  equipment  is  currently  the  norm 
and  is  a major  concern  for  the  maintenance 
trairiinq  area,  and  must  therefore,  tie  con- 
sidered in  trainer  desiqn. 

Design  for  Improved  Training  Effectiveness 

Improved  training  can  potentially  effect  sub- 
stantial savings  by; 

• Reducing  the  number  of  required  field 
personnel . 

• Reducing  traininq  time,  thereby  making 
trained  tecfinicians  available  sooner 
and  longer. 

• Reducing  the  need  to  retrain  inadequately 
trained  personnel. 

• Reducing  the  amount  of  time  operational 
equi()ment  and  personnel  are  devoted  to 
OJT. 

Address inq  current  training  deficiencies 
The  use  of  actual  equipment  trainers  Tor  main- 
tenance instruction  limits  the  effective 
training  of  many  critical  procedures.  A well 
documented  problem  in  current  6883  training, 
for  example,  is  the  frequent  unavailability 
of  a fully  operational  test  station.  This  is 
a function  of  the  equipment's  inherent  low 
reliability  and  the  significant  "down  time"  -- 
i.e.,  lost  traininq  time  --  associated  with 
required  maintenance.  Test  station  unavail- 
ability is  especially  pronounced  in  the  train- 
inq environment  due  to  intermittent  use  of 
the  station,  station  misuse  by  trainees,  less 


pxjiprienced  maintenance  personnel,  and  train- 
inq facilities'  low  priority  with  respect 
to  receipt  of  needed  replacement  parts, 
fonsequentl y , the  effectiveness  of  Current 
6883  training  and  traininq  for  comparable 
equipment  is  suspect. 

The  low  availability  of  a-rj,)]  equipme't 
trainer-,  together  with  C'  ■••n  ^or  student 
and  equipment  safety  lin.it-,  t-u  trainee's 
"hands-on"  practice  of  gen-ial  n-.i  i ntenance 
procedures.  In  particular,  use  of  actual 
equipment  trainers  severely  limits  the  range 
of  equipment  faults  and  emergency  conditions 
to  which  trainees  can  be  systematically 
ex[)osed.  Consequently,  trainees  are  not 
permitted  sufficient  practice  troubleshooting 
problems  they  are  likely  to  encounter  in  the 
field.  Duplication  of  a controlled  set  of 
equipment  faults  generally  requires  physical 
insertion  of  costly  prefaulted  hardware 
components.  Permanent  damage  to  the  actual 
equipment  is  simply  not  an  option.  Simulator- 
based  traininq  systems,  on  the  other  hand, 
permit  the  insertion  of  preprogrammed 
malfunctions  upon  instructor  command.  The 
simulator-based  system  is  decidedly  more 
flexible  in  training  situations. 

Providing  a_dd^d_  instructional  capabi  ljty 
A major  advantage  of  simulator-based  traininq 
systems  is  the  closed-loop  nature  of  the 
computer  driven  and  computer  sensed  events. 
Three-Level  Apprentices,  for  whom  the  6883 
Simulator  System  is  designed,  are  not  per- 
mitted to  practice  "free-play"  troubleshooting 
techniques.  Therefore,  a system  that  forces 
strict  adherence  to  prescribed  procedures  is 
appropriate.  HRL's  original  RFP  for  the  6883 
recognized  this  basic  maintenance  philosophy 
and  required  that  any  candidate  simulation 
system  not  permit  the  trainee  to  advance  if 
he  deviates  from  prescribed  procedures.  This 
requirement  reflects  the  theory  that  learning 
is  optimized  by  not  permitting  practice  of 
incorrect  responses.  A computer-based,  closed- 
loop  system  is  ideally  suited  to  such  a re- 
quirement. 

Furthermore,  because  the  computer  can  monitor 
step-by-step  trainee  performance  and  can 
provide  appropriate  preprogrammed  feedback/ 
guidance  to  assist  the  trainee  as  required, 
the  instructor  is  freed  from  many  of  the 
routine  tasks  of  "instruction.”  This  could 
result  in  improved  (i.e.,  lower)  instructor/ 
student  ratios,  thereby  effecting  personnel 
savings. 

A related,  often  touted  "advantage"  of 
computer-based  (or  other  programmed  instruc- 
tion) systems  is  that  they  permit  self-paced 
learning.  Accordingly,  trainees  need  spend 
no  more  time  in  traininq  than  their  own  rate 
of  progress  demands.  This  is  an  advantage, 
however,  only  if  the  total  traininq  or  career 
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is  striicturpd  mrtnaqcd  tn  .icropt  ,i 
cont  inijinc)  fluw  rather  than  perindic  liatch 
delivery  nt  trained  personnel,  little  is 
pained  t'v  a self-paced  trainimj  sepnient  if 
upon  completion  the  trainee  must  mark  time  he- 
fpre  he  enters  a suhseipient  tnck-ste[)  traininp 
segment  or  ht'fore  tie  reieives  an  appropriate 
field  ass  i (jnment  . 

Performance  measurement,  rt  critical  factor  in 
improving  training  ef  ft-ct  iveness  is  appropri- 
ate performance  measurement . Performance  mea- 
surement ri'fers  tn  the  reduction  of  the 
trainee's  step-hy-step  [lerf ormaiu.e  data  to 
meaning*ul  indices,  these  indices  can  reveal 
prohlem  areas  that  might  otherwise  go  urumticed 
in  the  overwhelmiiH)  (juantity  of  data  that  a 
computer-based  systi'm  can  monitor. 

Among  the  yarious  [lerformance  measures  main- 
tained tiy  the  6883  Simulator  System,  for 
example,  are  counts  of  each  trainof*''.  procedur- 
al errors  in  yarious  lesson  segments;  how 
often  does  he  deyiate  from  the  prescribed 
seguence  of  actions  outlined  in  the  appropriate 
maintenance  manual?  Consistently  high  error 
counts  might  suggest  that  the  trainee  is  sim- 
ply negligent  in  attending  to  the  manual's 
instr  i(.t  ions  or,  a 1 terna  t i yel  y , that  the  manual 
itself  is  not  clearly  written.  The  latter 
possibility  can  be  explored  by  examining  the 
error  counts  of  other  trainees  to  determine 
if  they  are  erring  on  the  same  steps.  If  so, 
tile  computer-dri  yen  lesson  material  might  be 
revised  to  provide  clarification  at  specified 
points  in  the  l(*sson  to  compensate  for  the 
manual 's  ambiguity. 

In  addition  to  serving  as  instructional  aids, 
appropriate  performance  measures  provide  a 
means  of  assessing  whether  the  trainee  has  met 
final  performance  criteria.  This  could  reduce 
the  chances  that  inadeguately  trained  personnel 
would  be  released  into  tiie  field. 

Design  for  Supjiortabi  1 i ty 

Increased  interest  has  been  demonstrated 
recently  in  the  reduction  of  life-cycle  system 
support  costs.  This  concern  is  reflected  in 
the  recent  procurement  of  F-16  0- level  main- 
tenance simulators  based  upon  the  total  system 
life-cycle  cost,  rather  than  mere  hardware 
acguisition  costs.  To  achieve  this  objective 
of  low  life-cycle  support  costs,  a number  of 
issues  must  be  addressed  during  the  system 
design  including: 

t Simulator  System  Maintenance  - is  con- 
tractor or  organic  maintenance  the  most 
cost-effective  solution?  What  self-test 
capability  is  necessary?  What  spares 
inventory  is  appropriate? 

• Simulator  System  Fxpandabi 1 i ty/Flexibi 1 i ty 
can  the  simulator  be  cost-effectively 
(TKjdified  or  expanded?  If  major  changes 


are  made,  do  these  reguire  a complete 
system  redes ignt 

• fonf  i gura f i on  Management  - if  changes  are 
made  to  tfie  operational  eguipment,  how 
are  these  ( hanges  implemented  and  con- 
trolled on  fhe  simulator? 

Simulator  system  maintenance.  Any  iiractical 
alternative  tn  actual  eguipm(‘nf  trainers  must 
b(“  reliafile,  easily  maintairied.  and  thereby 
cons i stf'nt  1 / availalile  for  trair.mg.  Meeting 
these  criteria  imjiat  ts  s i gri  i f i r ant  1 y fne  rosts 
associated  Witn  reiilacement  part  , and  fhe  re- 
guired  ma  i ri  tenani.e  tor.e.  total  spares 
Support  for  the  VTAS  O-leyel  n.amfenance  simu- 
lators delivered  to  the  Davy  and  Marine  Corps, 
for  erampli',  accounted  for  only  2.S  (lercent  of 
the  simulator  systen'  cost.  This  'igure  is  in 
shaigi  ronfrast  wifti  th(‘  more  usual  lf)-20  per- 
cent siiar-es  cost  associated  with  support  of 
actual  egiiiiiment  trainers  procured  at  signifi- 
cantly higher  costs.  Moreover,  the  reguired 
mainfenanct*  time  to  date  on  the  '.'tAS  trainer 
has  been  iieg  1 i<) i bl e . 

Provision  for  long-term  maintenance  of  simula- 
tor-based training  systems  is  a conf rovers i a 1 
topic  across  the  Services.  If  fhe  military 
assumes  maintenance  responsitii  1 i ty  *or  these 
devices,  is  there  need  to  estatilish  a dedicated 
career  field  for  simulator  maintenance  personnel’ 
Moreover,  what  modifications  must  be  made  in 
existing  policies  to  accoiiinodate  maintenance 
of  ttiis  new  breed  of  tiaining  devices?  Air 
Force  Logistics  Command  (AILC)  policy,  for 
example,  reguires  that  spares  be  kept  in  inven- 
tory for  only  a limited  period  of  time,  after 
which  they  are  discarded.  It  is  possible  that 
given  the  anticipated  reliability  of  simulator 
systems,  the  demands  on  inventoried  spares 
would  be  so  few  and  infreguent  that  the  spares 
would  not  he  in  the  inventory  by  the  time  they 
are  needed.  An  alternative  approach  to  the 
maintenance  issue  is  to  procure  full  contractor 
maintenance,  fiowever,  this  reguires  a level 
of  confidc'nci'  in  the  contractor's  continued 
coninitment  tn  the  s imu I ator-based  trainer  mar- 
ket. The  long-term  maintenance  issue  is  com- 
plex and  far  from  resolution  at  this  time. 

In  the  near-in  case  of  the  6.883  Simulator 
System,  current  plans  call  for  a hybrid 
approach  to  maintenance,  involving  participa- 
tion by  both  the  Air  Force  and  Honeywell,  ’he 
simulation  hardwari'  is  designed  to  tie  repair- 
alile  to  th<>  component  level  tiy  S-Level  Air 
Force  Specialists.  Prior  to  df' livery  of  the 
system,  tioneywell  will  conduct  a maintenance 
training  program  that  will  eguip  a small  (2-4) 
team  nt  instructors  to  iierform  (leriodic,  pre- 
ventive, and  corrective  ma inf enance  on  the 
6883  Simulator.  These  same  persons  will  cri- 
tlgue  maintenance  manuals  to  be  delivered  with 
the  system.  Final  versions  of  the  documenta- 
tion will  reflect  their  coiirients. 
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systi'n"  md  i nt.i  i n,ihi  1 i t y di'siqn  nh  jectivf’S 
I'liliidt'  ffijin roinents  fo>'  nn  iinicjiio  ma i iitptitincf! 
'.kills  'll  tkii'.  spi'clalist  .ind  riM|ui rfmcnf s fnr 
fill'  ifwi'S*  [lossihli'  prpyont  i VC  nia  intcnanci' 

and  ("pjipnipnt  a I i 'innipi't  s . Off-t.lu’- 
.'iflf,  loc.illy  lyailahlp  sy'.kpir  cnmpnnpnts  ai'P 
aSPd  w'lprpyi'i'  'p.isihlp.  A (Ipfailpd  list  n* 

I PI  nmr''‘iidpd  sp.iPk'S  will  tip  dk'liyprpd  to  thp 
All-  ■iiiii'  *01  prociirp'i'Pnf  ctm’.  i dpra  t i On  . 

Aj»oiti.i  k,.i-i  spl‘-tp'.t  and  ^aul  t - i sol  a t ion  pro- 
pd,.rp',  111'  hpiiifj  pr.ividpd  tor  thp  systpm 
I'ltpr*  p I",  ind  .iimjlation  hardwarp.  Sottwarp 
['>■  jni"  am-  hninij  proyidpd  to  pprmit  daily 
1 ii'i’i-d  .Tat  as  chpiks  thi'  siniolator  prior 
» ,t  1 1p"T  1 nst riji  t i in . Othi  r.  morp  dntailpd 
• I .nl  at  i on  programs  iindpr  dpyplnpim‘nt 
.(■rmif  t.ipi)  tiijlt  isolation  to  ma  jor  rpplatp- 
it'*'  ■.i‘'>t'l  ins  and  cards. 

All  I omputPr  and  ppripiicral  pguipnipnt  will 
Iikpl<  t'*'  totally  supported  through  a separate 
I'trai*  witti  klnnpywnl  1 I ntorma  t i on  Sf'rvicPS. 


I ypandatii  1 i ty/f  lexitii  1 i ty . Modifications  to 
actual  pguipmpnt  trainprs  can  reguire  major 
rpsourcp  coiimi  tmpnts . Fxtensivp  rptrofitting 
of  fipld  pguipmpnt  leads  to  costly,  lengthy 
onsitP  modification  of  thp  corresponding 
training  pguipmpnt,  with  the  coincident  loss 
of  training  time.  Major  model  changes  often 
result  in  scrapping  the  existing  trainer  for 
a rigilacpment  model.  Lypn  minor  changes  to  the 
trainer  to  increase  its  ca[iab  i 1 i t ies  can  he 
exfiensive  if  tiie  system  is  not  designed  to 
accommodate  cfiangps. 

w'lth  proper  design,  the  impact  of  changes  can 
tie  minimized  in  s imul a tor-liaspd  training  sys- 
tems. Many  extensiye  revisions  can  tie  accom- 
modated largely  through  simple  software  changes 
and  low-cost  simulated  hardware  changes.  Even 
major  model  changes  can  he  reflected  without 
complete  system  reiilacement. 
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Figure  4.  6883  Simulator  System  Hardware  and  Software  Modules. 
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The  (iosicin  of  the  Sinujl.ifoi  Sysfcin 

coiu  t'i'n  for  o K[Mtid.ihi  1 1 1 y/ 1 1 on  itn  1 i ty . The 
6HH3  Sirnuliifnr  System  is  <f  multicomputer  sys- 
tem wfiuh  drives  simiildtinns  of  the  hflKT  Test 
Station  .lod  associated  1 Rtls  through  apfiropriate 
interface  hardware.  Student  actions  on  the 
simulated  eguiiimerit  are  sensed  hy  the  computer 
through  the  same  interfaces.  Appropriate  stu- 
dent guidance  and  feedhack  is  provided  hy  a 
CRT/kpyhoard  and  random-access  slide  projector, 
''tiident  performance  is  recorded  hy  the  com- 
puter system  and  is  output  to  a cassette  tape 
and  high-speed  printer  for  recordkeeping, 
figure  4 illustrates  the  training  system  hard- 
ware block  diagram. 

A minimum  of  three  additional  simulator  training 
devices,  different  from  the  68R3  can  be  driven 
by  the  Honeywell  716  computer  that  is  acting  as 
a classroom  controller.  This  feature  accommo- 
dates the  Air  Force's  long-term  need  for 
increasing  numbers  of  simulators  to  meet  their 
training  requirements.  Moreover,  as 
the  focus  of  training  changes  with  the  evolution 
of  test  equipment,  the  hardware  system  configu- 
ration developed  for  the  6883  can  adapt  - 
requiring  only  the  replacement  of  obsolete 
simulation  hardware  with  updated  simulations; 
major  system  components  {e.g.,  student  con- 
sole, student  station  controller,  interfac,.s) 
can  be  reused  with  the  replacement  simulation. 

The  software  and  courseware  architecture  are 
similarly  designed  for  flexibility  (Figure  4). 

As  additional  or  replacement  simulations  are 
incorporated  into  the  system,  only  the  data 
base  modules  specific  to  the  new  test  equip- 
ment must  be  added  to  the  software.  Instruc- 
tional materials  or  courseware  are  prepared  in 
a manner  that  facilitates  generation  and/or 
modification  of  lesson  materials  by  instructor 
or  support  personnel.  This  becomes  an  especi- 
ally important  feature  when  reconfiguration  of 
equipment  requires  changes  in  the  training 
course  content.  These  kinds  of  considerations 
are  especially  important  when  designing 
trainers  for  developing  systems  (e.g.,  F-16). 
Numerous  engineering  changes  should  be  antici- 
pated, and  a simulator  system  designed  for 
maximum  modifiability  can  minimize  the  cost 
impact  of  those  changes. 

Configuration  management.  The  procedures  for 
implementing  and  controlling  changes  to  the 
simulator  are  not  yet  clearly  defined.  It  is 
possible  that  the  configuration  management  (CM) 
system  for  simulators  will  be  different  from 
that  required  for  actual  equipment  trainers. 

The  CM  system  must  process  all  changes  made  to 
the  actual  equipment,  determine  if  those  changes 
impact  the  operation  and/or  effectiveness  of  the 
simulator,  and  process  the  resultant  changes  to 
the  simulator  software,  hardware,  courseware, 
or  documentation. 

Because  the  simulator  operates  in  a manner 
different  from  the  actual  equipment  and  incor- 


porates only  a '.elected  subset  of  all  possible 
hardware  ft'a turns,  only  a small  number  of  the 
original  ihanges  need  be  made  to  the  simulator. 
Changes  unique  to  the  training  system  (e.g., 
added  instructional  features)  may  also  require 
specialized  CM  procedures  to  assure  that 
those  changes  do  not  cause  the  simulator  to 
function  differently  from  its  operational 
counterpart,  resulting  in  negative  training. 

It  is  also  unclear  if  the  differences  in 
complexity  tietween  the  simulator  and  actual 
equipment  impact  the  CM  procedures  required. 
Further  study  is  needed  to  define  the  most 
cost-effective  procedures  to  employ  for  simu- 
lator configuration  'I'anagement . 

The  Air  Force  Human  Resources  Laboratory 
(AFHRL)  intends  to  examine  alternative  CM 
solutions  for  the  6883  Simulator  System. 
Hopefully,  through  their  study,  a better 
understanding  of  the  issues  will  evolve. 

SPECIFICATIONS  S STANDARDS  APPLICATION 

A remaining  consideration  that  can  signifi- 
cantly impact  the  cost  of  fabricating  and 
documenting  training  systems  is  the  applica- 
tion of  accepted  military  specifications  and 
standards.  Indiscriminate  application  of 
existing  specifications  and  standards  developed 
for  operational  equipment,  appears  unnecessary, 
costly,  and  often  inappropriate  as  the  training 
philosophy  shifts  to  replace  actual  equipment 
with  simulators.  Indeed  full  compliance  with 
these  specs  and  standards  nullifies  many  of 
the  potential  benefits  of  low-fidelity  simula- 
tion. The  6883  program  produced  a functional 
specification  that  can  serve  as  a model  for 
specifying  future  simulator-based  training 
systems.  Although  MIL-STD  490  served  as  a 
guideline  for  organizing  the  6883  document, 
deviations  from  that  prescribed  organization 
were  incorporated,  where  appropriate,  to 
accommodate  the  trainer-unique  material  dis- 
cussed. Likewise,  fabrication  of  the  6883 
Simulator  System  is  in  accordance  with  Best 
Commercial  Practices.  This  permits,  for 
example,  using  non-ruggedized  (and  thereby 
less  expensive)  computers  and  simulation 
equipment.  Suspension  of  the  traditional 
military  standards  governing  equipment  fabri- 
cation is  appropriate  given  that  the  simulator 
system  is  intended  for  classroom  rather  than 
field  use.  It  will  not  undergo  the  routine 
disassembly,  transport,  and  reassembly  (at 
potentially  unfavorable  sites)  for  which 
operational  test  stations  are  designed. 

A very  recent  Department  of  Defense  directive 
(DOD  Directive  4120.21)  recognizes  the  need 
to  reassess  the  strict  enforcement  of  existing 
specifications  and  standards.  The  revised 
policy  directs  the  services  to  establish  pro- 
cedures for  the  selective  application  and 
tailoring  of  specifications  and  standards,  to 
impose  only  "essential  system  needs,"  to 
avoid  "blanket  contractual  imposition,"  and 


328 


to  solicit  rec omnpnddt ions  from  prospnct i vo 
contractors.  Thpsf  procndiirps  apply  throuqh- 
oiit  the  procurpmcnt  procpss;  pach  program  is 
rpguirpd  to  documpnt  thp  pxtpnt  to  which 
sppcif ications,  standards,  and  data  itpm 
dpscriptions  havp  hppn  modi  find. 


nPfN  QllFSTION 

Niimprous  stud  IPS  (p.g.,  11,  1?,  13)  havp 
concludpd  that  simulators  train  equally  as 
welt  as  operational  pquipm(>nt  alternatives. 
However,  most  of  these  studies  have  suffered 
♦rnm  the  lack  of  adequate  measures  of  transfer 
of  training. 

The  Air  Force  Human  Resources  Laboratory 
recognises  this  deficiency  and  is  initiating 
a formal  program  to  determine  the  relative 
merits  of  s imul ator-based  training.  A 
formal  training-effectiveness  analysis  of 
the  6H83  s/sfem  will  be  conducted  tiy  AFHRL 
to  assess  the  practicality  of  [-level  main- 
tenance simulation.  The  relative  merits  of 
actual  pqu'pment-based  and  simulator-based 
training  will  be  contrasted  through  a com- 
parison of  students  trained  using  the  present 
operational  6H83  Test  Station  and  those 
trained  using  the  simulator.  A range  of 
simulation  techniques  and  training  procedures 
has  been  specified  to  permit  assessment  of 
the  relative  effectiveness  of  different 
approaches.  Detailed  performance  measures 
are  specified  which  far  exceed  the  instruc- 
tor's immediate  needs.  These  data  wilt  be 
recorded  on  cassette  tape  for  later  statisti- 
cal analysis  and  can  provide  insight  into 
both  the  simulator  training  effectiveness  and 
the  student's  learning  process.  Finally, 
the  hardware  design  incorporates  a number  of 
features  which  facilitate  data  collection  and 
system  modification.  Through  the  inclusion  of 
such  additional  hardware,  software,  and 
courseware  features,  an  effective  evaluation 
of  the  feasiblility  and  practicality  of  main- 
tenance simulation  will  be  possible. 
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RFAL-TIMf  SIMULATION  OF  JEFF(B) 
AMPHIBIOUS  ASSAULT  LANDING  CRAFT 

DAVID  YIH 

N<iV(il  Training  Equipment  Center 


INTRODUCTION 

Twd  prototype  Amphibious  Assault  Landing 
Craft  (AALC)  designated  JEFF(A)  and  JEFF(B) 
are  being  developed  by  Aerojet  General  Cor- 
poration, Tacoma,  Washington  and  Bell  Aero- 
space Company,  New  Orleans,  Louisiana,  re- 
spectively (figure  1).  The  craft  are  designed 
to  ride  on  air  contained  by  the  flexible  skirt 
Systems  and  pressurized  to  slightly  higher 
than  the  ambient  pressure  by  the  fan  systems. 

The  missions  of  the  craft  are  to  ferry 
troops  and  supplies  from  supply  ships  to  a 
landing  beach  and  return.  The  ships  are 
usually  cruising  off-shore  to  avoid  attack  by 
the  shore  batteries  and  surface-to-surface 
missiles.  In  perform.ing  the  missions,  the 
crafts  must  enter  or  back  out  from  the  well  of 
the  supply  ships  or  come  alongside  the  ships 
tor  reloading  or  unloading.  The  craft  must  be 
able  to  ride  on  the  waves  at  sea  state  2, 
travel  across  deep  water,  shallow  water  and 
Surf  zone,  land  on  a sloping  beach,  and  drive 
inland.  The  craft  are  designed  to  be  able  to 
negotiate  approximately  12%  slope  at  120,000 
lbs.  normal  payload. 

This  report  presents  the  feasibility 
study  of  developing  a real-time  AALC  simu- 
lator for  JEFF(B)  craft  covering  the  over 
water  operation  and  planning  the  over  land 
operation. 

METHOD  OF  APPROACH 

The  JEFF(B)  craft  has  been  selected  for 
this  study.  The  reason  for  selecting  the 
JEFF(B)  over  the  JEFF(A)  was  that  the  JEFF(B) 
had  more  data  available  at  the  time  the  pro- 
ject was  being  initiated. 

The  perturbation  method  has  been  exten- 
sively used  for  vehicle  simulation.  However, 
the  fidelity  of  using  the  method  to  duplicate 
the  AALC  behavior  is  dependent  upon  the  vali- 
dated data  obtained  from  the  scaled  model 
tests.  As  was  pointed  out  by  Doctors  and 
Shamia  (Reference  1),  the  perturbation  metitod 
using  resistance  from  constant  speed  towing 
tank  results  is  not  sufficient  to  predict  the 
maneuvers,  particularly  involving  large  accel- 
eration near  hump  speed.  For  AALC  operation, 
large  variation  of  acceleration  and  control 
forces  are  anticipated.  Furthermore,  a small 
change  of  the  state  of  the  craft  may  result 
in  iiighly  nonlinear  forces  and  large  coupling 
effects  between  degrees  of  freedom.  Tiierefore, 


applying  the  perturbation  metfiod  to  simulate 
an  AALC  is  questionable. 

The  modeling  technique  used  in  the  pre- 
sent simulation  is  quite  different  from  the 
conventional  perturbation  method.  The  mathe- 
matical model  is  based  on  the  nonamnesic  and 
nonlinear  concepts.  As  the  test  results  will 
show,  the  success  of  this  model  is  mostly  due 
to  the  simulation  of  the  vehicle  generated 
wave  (VGW)  and  air  cushion  systems.  The  model 
was  developed  by  the  C.S.  Draper  Laboratory 
(References  2 and  3) . 

MATHEMATICAL  MODEL 

The  mathematical  model  has  six  degrees  of 
freedom  and  consists  of  five  major  sections; 
namely,  the  equations  of  motion,  effector, 
engine,  air  cushion  system,  vehicle  generated 
wave,  and  ocean  wave  systems  (figure  2).  The 
terrain  model  portion  will  be  added  later. 

Equations  of  motion 

To  provide  proper  motion  and  visual  cues 
to  an  operator,  the  equations  of  motion  are 
derived  with  respect  to  the  operator  station. 
The  ETA  equation  is  the  control  equation 
which  is  used  to  calculate  the  total  wave 
heights  for  over  water  operation  or  the  ter- 
rain heights  for  over  land  operation.  However 
the  terrain  model  is  yet  to  be  incorporated  in 
the  program.  These  ETA  values  are  then  used 
to  calculate  the  cushion  forces  and  moments 
acting  upon  the  craft.  Using  the  ETA  equation, 
there  is  no  need  to  employ  two  separate  models 
for  amphibious  operation.  Thus,  considerable 
savings  on  the  development  cost  of  the  mathe- 
matical model  and  real-time  program  have  been 
real ized. 

E J f e^t^r  and  Engine 

Tfie  technique  used  to  model  the  effector 
and  engine  is  a conventional  one.  The  data 
provided  by  the  Bell  Aerospace  Company  for 
simulating  these  components  are  considered  to 
be  adequate. 

A i r Cush  ion  Sys t em 

The  craft  is  supported  by  means  of  the 
air  cushion  pressure.  Therefore,  craft  per- 
fonnance  is  intimately  related  to  the  accurate 
determination  of  cushion  pressure.  The  cush- 
ion model  is  described  by  a set  of  six 
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JEFF  B 


Figure  1.  Cutaway  views  and  Characteristics 
of  the  JLFF  Craft 
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TABLE  1.  SELECTED  PRINCIPAL  CHARACTERISTICS  OF  THE  JEFF  CRAFT 


JEFF(A) 

JEFF(B) 

Overall  length  on  cushion 

96' 

87' 

Overall  beam  on  cushion 

48' 

47' 

Height 

23' 

23.6' 

Design  gross  weight 

340.000  lbs 

325,000  lbs 

Design  payload  (overload) 

120,000  (150,000) 

120,000  (150,000) 

Engine 

6 Avco  Lycoming 

TF-40  Free  Turbine 

Engine  totaled 

16,800  hps. 

same 

Propul sors 

4 Reversible  Pitch 
Shrouded  Propellers 

2 Shrouded  Reversible 
Pitch  Propellers 

2 Bow  Thrusters 

Life  Fan 

8 Single  Centrifugal 

Fans 

4 Double  Centrifugal 

Fans 

Control  system 

Fly-by-wi re 

4 Rotatable  Propulsors 
Yaw  rate  feedback 

Auto  pilot 

same 

2 Rotatable  Bow  Thrusters 
2 Aerodynamic  Rudders 

2 Shrouded  Propellers 

Skirt  system 

Looped  Pericell 

5'  height 

Bag  Finger  with 

Stability  Trunks 

5'  height 

Speed  (Seastate  2 and 

25  knts  Headwind) 

50  knts 

50  knts 

Range 

200  n.  miles 

200  n.  miles 

Maximum  slope 

11.5% 

13% 
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nonlinear  continuity  equations  which  are  iter- 
atively solved  hy  a multidimensional  Newton- 
l^aphson  procedure.  Usinij  the  modeling  tech- 
nique. this  AALC  mathematical  model  does  not 
have  e'plicit  damping  terms  except  in  yaw. 

Ttie  QPIWP  tenrs  in  the  continuity  equations 
(figure  3)  actually  provide  damping  to  the 
craft. 

Vehicle  GenersUed  Wave  and_0c_ean_ W^ve 

The  concept  of  the  VGW  system  is  that 
wave  conf  Kjurat ion  is  a function  of  past  velo- 
city history  and  present  state  of  the  craft. 
Modeling  the  VGW  is  the  most  complex  part  of 
the  whole  simulation.  The  purpose  is  to  ob- 
tain a VGW  height  under  the  designated  hull 
point.  This  is  done  by  integrating  frtri  the 
past  T - -t  to  present  T = 0 over  82  values  of 
fernal  function  (K). 

A total  of  25  points  are  required.  The  prep- 
aration for  the  values  of  the  Kernel  function 
is  a very  tedious  work.  It  took  approximately 
three  minutes  to  compute  one  Kernel  value.  A 
total  number  of  30  x 30  x 82  values  were  com- 
puted and  tabulated  in  82  tables  which  are 
stored  in  an  equal  time  interval.  The  VGW 
profile  under  the  hover  condition  is  shown  in 
figures  A and  5. 

The  seawave  simulation  is  a sinusoidal 
wave  system.  It  takes  in  one  dominant  fre- 
quency at  a time.  It  is  desirable  that  it  be 
replaced  by  a random  wave  system  for  more 
real  1 s t i c s imu 1 a 1 1 on . 

The  off-shore  wave  system  represents  the 
waves  propagating  from  deep  water,  through 
shallow  water,  and  surf  zone  to  a beach.  The 
wave  model  is  based  on  the  small  amplitude 
wave  theory  with  the  Stokes  second  order  cor- 
rection for  the  wave  profile.  The  basic  char- 
acteristics of  the  off-shore  wave  system  are 
shown  in  figure  6. 

Terrain^  Model 

When  the  craft  is  detected  to  be  on  a 
beach  or  land,  the  terrain  heights  will  tie 
calculated  instead  of  the  wave  heights.  The 
designed  terrain  heights  must  be  measured  with 
respect  to  the  main  reference  level  as  illus- 
trated in  figures  7,  8,  and  9. 

8EAL-TIME  PROGRAMMING 

The  real-time  program  is  organized  into 
five  major  modular  sections  (figure  10). 

These  are: 

Program  load  and  initiation 

Background 

Foreground 


''^rap  handling 
f (X’lmon  storage 

To  start  an  experimental  run,  the  AALC  program 
arid  VGW  tables  are  loaded  f rrm  separate  mag- 
netic tapes  with  all  interrupts  inhioited. 

The  traps  are  initialized.  If  the  program  is 
successfully  loaded,  the  program  entry 
INIT'iTRT  initialize',  the  I/O  and  the  timing 

and  lr,i'  • ic>gi  ,' /. 

height  profile  calculatiori  is  performed  in  the 
background.  The  background  tasks  take  up  all 
computer  time  not  spent  ir.  ttie  foreground. 

The  tasks  of  foreground  operation  are  to  pro- 
vide the  proper  tine  interval  ‘or  AALC  mathe- 
matical model  of  the  real-time  operation. 

There  are  three  program  modes  of  operation, 
namely  hold,  reset,  and  operate  modes.  The 
operate  mode  is  the  real-time  simulation  of 
AALC  model.  The  vehicle  is  maneuverable  in 
this  mode.  The  traps  handle  the  abnormal  or 
error  conditions  of  the  software  and  hardware. 
The  common  storage  acts  as  a data  pool  for  the 
program. 

Program  Descr iption 

The  mathematical  model  is  implemented  on 
the  Sigma  7 digital  computer  of  Naval  Training 
Equipment  Center's  (NAVTPAEOUIPCEN)  TPADEC 
flight  simulator.  The  program  is  written  in 
assembly  language  and  floating  point  arith- 
metic is  used.  The  program  consists  of  approx 
imately  16,000,  32-bit  words  and  is  iterated 
at  20  cycles  per  second  or  50  milliseconds  per 
cycle.  The  computer  48  K memory  is  fully 
occupied  by  the  instructions  and  mostly  by  the 
data  of  the  VGW.  For  worst-case  operation, 

50,  34,  and  16  percent  of  the  50  mi  1 1 iseconds 
are  spent  in  running  the  main  program,  off- 
shore wave  and  VGW  system,  respectively. 

EXPERIMENTAL  SYSTEM  SETUP 

The  system  designated  L (figure  11)  is 
incorporated  with  a Computer  Line  Drawing  Dis- 
play Unit  manufactured  by  Evans  and  Sutherland 
Computer  Corporation,  Salt  Lake  City,  Utah. 

The  system  designated  W (figure  12)  is  incor- 
porated with  a Wide-Angle  Visual  System. 

These  visual  systems  are  available  in  the 
NAVTRAEQUIPCEN  laboratories.  Because  of  the 
limited  fundings,  existing  equipments  have 
been  utilized.  The  purpose  is  to  demonstrate 
the  feasibility  of  using  these  visual  systems 
for  the  AALC  experimental  training  device. 

System  L 

The  Computer  Line  Drawing  Display  unit 
interfaces  with  the  Sigma  7 computer  by  a sub- 
routine of  approximately  500  instructions . 

Once  the  unit  is  started,  it  operates  indepen- 
dently, fetches  the  data  and  drawing  instruc- 
tions from  the  computer  memory,  and  continu- 
ously draws  the  well  of  the  LtlA  mother  ship. 
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Figure  J.  Cushion  f'ressure  Scheniatk 
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Figure  10.  Basic  Software  Flow  and  Structure 
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Figure  11.  System  with  Line  Drawing  Display 
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Figure  U.  JFrF(B)  Drag  Characteristics 
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fitch  Frequency  Response  with 
VGW  5”  Impulse.  U * 0 


Figure  14.3.  Poll  Frequency  Response 
VGW  Impulse,  U * 0 


Pitch  Frequency  Response  with 
VGW  br  Impulse,  U - 50  knots 


Figure  14.4.  Roll  Frequency  Response  with 
VGW  2®  Impulse,  U * 50  knots 
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The  AALC  attitude  instructions  are  stored  in 
the  compiuter  memory  liy  the  program  of  AALC 
mathematical  model  and  are  updated  every  pro- 
gram cycle.  The  function  of  the  display  unit 
is  to  continuously  draw  the  well  of  a LHA 
mother  ship  being  viewed  from  an  AALC  opera- 
tor's station  during  the  docling  maneuvers. 

The  system  L integrating  the  modified 
and  instrumented  helicopter  cockpit,  digital 
program,  and  the  Computer  Line  Drawing  Display 
unit  has  been  used  to  obtain  performance  data 
on  the  simulation  and  allow  operators  to  per- 
form docking  maneuvers. 

Sister'  _W 

The  existing  NAVTPAEQLlIPCtN  Wide-Angle 
Visual  System  is  a single  channel  TV  system 
with  a field  of  view  of  60°  vertical  and  160° 
horizontal  using  TV  camera  and  an  Eidophor 
light  valve  projector.  The  camera  and  projec- 
tor are  1023-line  units. 

The  system  W integrating  the  replica  of 
JEfF(B)  control  station,  digital  program, 
Wide-Angle  Visual  system,  gantry  system,  1/50 
scaled  LPO  model,  and  10-ft  radius  spheric  dome 
is  being  used  as  an  experimental  training 
device.  The  camera  picks  up  and  processes  the 
image  of  the  physical  model  of  LPO  and  puts 
out  signals  to  the  Eidophor  unit.  It  pro- 
cesses signals  and  projects  the  image  of  the 
LPO  model  on  a spheric  screen  supported  by  the 
structure  of  the  spheric  dome.  The  picture 
displayed  on  the  screen  with  brightness  of 
5-foot  lambert  provides  the  visual  scene  to 
the  operator.  The  movement  of  the  gantry  upon 
which  the  camera  is  seated  is  driven  by  the 
outputs  of  navigational  positions  and  heading 
from  the  computer  program  which  is  governed  by 
the  operator's  commands  issued  from  the  con- 
trol station.  It  is  instrumented  the  same  as 
System  L.  Because  of  the  limitation  of  the 
gaming  area,  the  system  is  exclusively  used 
for  the  docking  maneuvers.  No  attempt  has 
been  made  to  collect  performance  data  from  the 
system. 

Pla  n for  Over  Land  Ope  rat  i_on 

The  mathematical  model  has  been  developed 
for  amphibious  operation.  The  current  model 
can  operate  on  a flat  ground.  The  plan  is  to 
add  the  terrain  model  to  the  program.  The 


data  base  will  be  designed.  No  sophisticated 
eguipments  are  required. 

T(^t  Result 

Data  dealing  with  the  over  water  man- 
euvers were  collected  using  System  L.  A 
total  of  five  runs  were  conducted  to  verify 
the  basic  characteristics  of  the  mathematical 
model.  The  VGW  profile  at  hover  condition, 
off-shore  wave,  hump  speed  and  frequency 
response  are  presented  in  figures  4,  5,  6,  13, 
and  14,  respectively.  A total  of  eight  runs 
were  conducted  at  various  entry  speeds  and 
control  settings.  The  collected  performance 
data  were  compared  with  the  data  provided  by 
NSRDC  from  a nonreal-time  JEFF(B)  simulation 
program.  The  data  are  presented  in  figures 
15,  16,  and  17.  The  correlation  between  two 
sets  of  data  were  satisfactory.  During  August 
1976,  a total  of  30  runs  were  conducted  by 
Mr.  James  Fein  of  NSRDC  to  verify  the  perform- 
ance of  the  craft  over  calm  water  and  over 
wave.  Most  of  the  runs  were  conducted  at  the 
entry  speed  of  50  knots  and  at  various  control 
settings.  Zero  and  high-speed  (over  hump 
speed)  turnings  were  performed.  The  tests 
were  conducted  over  wave  at  various  wave 
heights  (!'  and  3')  and  periods  { 5,  6,  7, 
and  7.5  seconds).  The  performance  data  were 
rated  satisfactory. 

After  completing  the  docking  maneuvers 
in  the  System  W on  28  February  1977,  Lt. 

J.N.  Mullican  and  Mr.  R.E.  Hughes  of  Amphi- 
bious Assault  Landing  Craft  Experimental 
Trials  have  made  comnents  on  the  operation  of 
the  experimental  design.  This  points  out  a 
need  for  further  refinement  of  the  mathemat- 
ical model. 

Conclusion 

System  L has  fulfilled  its  assigned 
objective.  The  existing  Computer  Line 
Drawing  Display  unit  has  been  utilized  to 
provide  the  interim  solution  to  the  docking 
maneuvers.  The  mathematical  model  was 
tentatively  validated  by  comparing  our 
collected  performance  data  with  the  data 
provided  by  NSROC's  nonreal-time  AALC  program. 
The  final  validation  of  the  mathematical 
model  will  be  made  when  the  full  trial  data 
or  data  from  1/6  radio  controlled  model 
comes  avai lable. 
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A LOW-COST  VISUAL  SLNSOR  SIMULATOR 


DR.  WILLIAM  McCORMICK,  RICHARD  KINNEY  AND  WALTER  MASON 
Technology  Incorpoiated 
and 

DR.  TONY  De THOMAS 

Air  Force  Flight  Dynamics  Laboratory 
Wright-Patterson  Air  Force  Base 


INTRODUCTION 

Pilot  acceptance  studies  of  Digital 
Avionics  Information  System  (DAIS)  concepts, 
conducted  by  the  Air  Force  Flight  Dynamics 
Laboratory,  reguired  cocKpit  presentation  of 
typical  forward  looking  sensor  imagery.  The 
objecti^s  of  the  studies  were  to  verify  that 
the  DAl” concepts  do  not  jeopardize  safety- 
of-flight  integrity,  measurably  degrade 
performance  of  flight  control  configurations, 
nor  degrade  the  pilot  effectiveness.  At  the 
s.'e  time,  the  resulting  system  must  not  only 
be  usable  but  be  fully  acceptable  to  the  pi- 
lot. The  AF  Flight  Dynamics  Laboratory  DAIS 
Simulation  Facility  was  developed  to  accom- 
plish these  objectives  through  subject  test- 
ing, using  a replication  of  a Close  Air  Sup- 
port aircraft  cockpit.  The  program  plan  for 
the  DAIS  Simulation  Facility  includes  both  a 
stand  alone  capability  and  integration  with 
the  FDL  Terrain  Board  Facility  which  will 
provide  a projected  televised  view  of  the 
simulated  fligiit  path  terrain  for  direct  pi- 
lot viewing  through  the  cockpit  window. 

To  enhance  the  realism  of  the  cockpit  envi- 
ronment, t/pical  visual  sensor  imagery  was 
reguired  which  would  be  representative  of 
forward  looking  radar,  low- 1 ight- level  tele- 
vision and  forward  looking  infrared  sensors, 
corresponding,  in  real-time,  to  the  projected 
scene.  A Visual  Sensor  Simulator,  described 
in  the  following  sections,  was  developed  by 
Technology  Incorporated  to  provide  a low-cost 
solution  to  this  reguireinent.  By  processing 
the  terrain  board  video  signal  in  real-time 
through  the  use  of  analog  circuit  technigues, 
simulated  radar  and  electro-optical  sensor 
imagery  was  generated  which  has  been  highly 
acceptable  to  experienced  pilots. 

The  Visual  Sensor  Simulator  was  designed 
to  present  representative  imagery  and  not  ac- 
tual target  signatures.  The  design  study  was 
based  on  various  target  signature  data  but  the 
correlation  of  sensor  return  for  comparison 
of  target  signatures  was  not  included  in  the 
initial  program  plan.  Future  studies  are 
planned  to  investigate  these  reguirements  in 
conjunction  with  other  programs. 

DE  S 1 UN  CONS  I DE  RAT ! DNS 

The  present  version  of  the  Visual  Sensor 
Simulator  was  designed  to  be  operated  with  a 


direct  terrain  board  video  signal,  although 
other  input  signals  are  feasible.  A gener- 
alized application  is  shown  in  Figure  1, 
where  the  primary  electrical  signal  is  pro- 
vided by  a TV  vidicon  that  is  responding  to  a 
visual  scene  generated  either  from  a terrain 
board,  a motion  picture,  or  a video  tape 
recording.  The  sensors  considered  in  this 
discussion  will  be  forward  looking  IR  (FLIR), 
forward  looking,  real -aperture  radar  (FLR), 
low- 1 ight- level  TV  (LLLTV),  and  synthetic 
aperture  radar  (SAR). 

Any  realistic  sensor  simulation  should 
approximate  those  sensor  parameters  that  are 
of  significance  to  the  huii,an  observer.  In 
Figure  2 a general  sensor  configuration  is 
presented,  including  the  elements  of  scene 
definition,  atmospheric  effects,  and  specific 
sensor  characteristics.  Scene  definition  in- 
cludes the  significant  parameters  (e.g., 
resolution,  reflectivity  R(a),  emissivity 

thermal  inertia,  object  contrast)  that 
are  of  importance  within  the  spectral  region 
of  the  sensor;  atmospheric  effects  include 
all  noise  and  spectral  dependent  attenuation 
effects;  finally,  the  sensor  itself  is  defined 
as  a complicated  function  of  S/I,  ratio, 
modulation  transfer  function  M(f),  signal 
compression,  and  various  other  special  sensor 
effects.  Consistent  with  the  senso""  model  of 
Figure  2,  each  of  the  four  sensors  will  be 
defined  in  terms  of  operating  S/N,  modulation 
transfer  function,  signal  compression  proper- 
ties, and  relevant  special  effects.  Referring 
to  Figures  1 and  2,  the  primary  analog  sensor- 
simulator  input  is,  in  all  cases,  generated 
from  a vidicon  and  is,  therefore,  restricted  to 
target  reflectivity  properties,  R{  ),  in  the 
visual  spectral  region;  any  useful  simulator, 
wiiether  analog  or  digital,  must  make  a corre- 
lation between  the  visible  R(A)  and  those 
target  properties  relevant  to  the  particular 
sensor  (e.g.,  i(\,T)  for  fllR  and  H{\)  in 
the  microwave  region  for  FLR). 

ANALOG  CIRCUIT_  TECHNIQUES 

For  the  cockpit  simulator  application, 
it  is  assumed  that  the  primary  TV  signal  will 
be  initially  noise-free  (S/N  = ■■)  and  that 
the  raster  scan  pattern  will  be  roughly  600 
lines,  30  frames/sec  or  equivalently  b MHz 
in  video  bandwidth. 
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Figure  1.  Sensor  Simulation  Application 


Figure  2.  Sensor  Modeling 


Figure  3.  General  Single-Channel  Processor 


Analog  circuit  components  process  each 
TV  raster  line  sequentially  with  the  process- 
ing performed  by  a cascade  of  high  perform- 
ance, operational  anpl i f ier-based  processing 
elements.  Utilization  of  OP-AMP  processing 
at  video  bandwidths  is  made  possible  by  the 
recent  availability  of  wide-band,  high  slew- 
rate  operational  amplifiers.  Figure  3 illus- 
trates the  general  single-channel  processor 
where  the  heart  of  the  processor  is  the  "OP- 
AMP"  processor  unit  henceforth  referred  to  as 
'the  single-channel  processor."  The  single- 
channel  processor  begins  with  an  OP-AMP 
signal-plus-noise  summation  where  the  raster 
signal  format  is  added  to  a flat  spectrum, 
level -control  led  noise  source  as  shown  in 
Figure  4.  The  next  stage  is  the  edge  enhan- 
cer which  is  essentially  a differentiator  and 
is  used  to  simulate  "hot  spots"  in  FLIP  and 
specular  returns  in  both  FLR  and  SAP  coherent 
radars.  The  next  processing  unit  simulates 
the  Overall  linear  sensor  transfer  function, 
M(f),  by  means  of  a flexible,  active  filter. 
The  final  processing  unit  is  usually  a zero- 
memory  nonlinearity  (ZMN)  designed  to  simu- 
late signal  blooming,  gray-level  compression 
and  target  R(').  c('i,T)  effects;  ideally,  the 
ZMfl  unit  should  have  independently  set  slopes 
and  breakpoints  as  illustrated  in  Figure  5. 

Utilizing  wideband  operational  amplifi- 
ers, acceptable  simulations  for  the  sensors 
were  achieved  by  using  the  "single-channel 
processor"  described  above  in  a breadboard 
version.  For  the  second  generation  simulator, 
a "two-channel  processor"  capable  of  selec- 
tively processing  targets  and  background  was 
developed.  In  order  to  implement  this  two- 
channel  processor,  it  is  necessary  to  detect 
targets  in  real-time  and,  with  proper  time 
phasing,  switch  between  a target  processor 
and  a background  processor.  Because  all  use- 
ful target  signatures  require  the  entire 
target  history  (e.g.,  width  between  sharp 
edges,  magnitude,  target  modulation,  etc.), 
the  principal  signal  path  of  the  two-channel 
processor  must  be  delayed  by  some  fixed 
amount  (Figure  6)  wiiile  the  target/background 
decision  is  being  made.  Fortunately,  low 
distortion,  video  time  delays  are  now  avail- 
able in  the  0 to  10  microsecond  range.  The 
target  detection  circuit  and  related  timing 
circuits  are  entirely  digital  and  control 
high-speed  CMOS  analog  switches  with  switch- 
ing times  on  the  order  of  10-20  nanoseconds. 

SEIlSpR  CHARACJi-ALy.!  tS 

Despite  the  generality  of  the  one-  and 
two-channel  processors,  the  specific  features 
of  the  individual  sensors  must  be  considered 
in  any  useful  analog  sensor  simulation.  The 
following  exposition  is  a sensor- by- sensor 
discussion  of  how  each  sensor  is  simulated 
using  the  analog  approach. 


Forward  Looking  Infrared^J^FLIRJ 

The  major  challenge  for  an  analog  FLIR 
simulation  is  the  accurate  modeling  of  scene 
thermal  emissivity.  A truly  accurate  TV- 
derived  FLIR  simulation  must  somehow  relate 
visual  reflectivity  to  IR  emissivity,  and  in 
addition,  account  for  thermal  inertia  effects 
Analytically,  the  TV  terrain  responses  can  be 
expressed  in  integral  fonn  as: 


>■4 

I Tv  " ^jy  / ll(')  b(A)  dV 

^3 


where  the  limits,  Lg  and  >,4,  represent  the  vis- 
ual wavelength  region  for  TV  response,  C{X)  is 
the  atmospheric  transmittance,  and  k is  a 
constant,  including  illumination,  etc.  The 
corresponding  FLIR  output  can  be  expressed  as: 


^2 
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where  X-]  < Xg  ^3  < ^4- 

Despite  the  difficult  thermal  inertia 
problem,  a relationship  does  exist  between 
e(X)  and  R(X)  in  the  form  of  Kirchoff's  law; 
namely,  that  t(X)  + R(X)  = 1 or  that  emissiv- 
ity and  reflectivity  sum  to  unity.  While  this 
relationship  does  not  directly  solve  the  prob- 
lem, inasmuch  as  the  visual  and  IR  wavelength 
regions  are  different,  it  does  indicate  that 
bright  TV  areas  will  in  general  be  dark  in 
the  IR  image.  Given  this  somewhat  "loose" 
situation,  a reasonable  approach  is  a two- 
channel  configuration  where  the  respective 
ZMN's  are  calibrated  according  to  the  ensemble 
averages  of  the  target/background  emissivities. 
Since  the  ZMN's  are  easily  altered  by  pot  ad- 
justments, experience  can  be  quickly  gained 
from  calibrating  real-life  TV,  FLIR  runs. 

Another  characteristic  feature  of  FLIR 
imagery  is  the  presence  of  "hot  spots"  on  man- 
made targets,  e.g.,  tanks  and  trucks.  One 
possible  method  of  simulating  the  "hot  spot" 
is  to  edge-enhance  the  characteristic  sharp 
edges  of  the  manmade  object  and  then  limit 
the  output  of  the  enhancer  with  a zero-memory 
nonlinearity.  With  a raster  scan  pattern  of 
variable  orientation,  a very  realistic  simula- 
tion of  the  "hot  spot"  feature  can  be  achieved. 

Additional  features  of  an  analog  FLIR 
simulation  are  the  "white-hot,"  "black-hot" 
options  which  can  be  easily  simulated  using  a 
simole  inverting  amplifier  and  also  the  pres- 
ence of  the  faint  raster  scan  pattern 
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Figure  4. 


Single-Channel  Processor 


f(XI 


F igure  5. 


Ideal  Zero-Memory  Ilonl  ineari  ty 


Figure  6.  Two-Channel  Processor 
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(nonunifonn  IR  detector  mosaic)  which  can  be 
simulated  using  a special-purpose  circuit 
synchronized  with  the  vertical  and  horizontal 
sync  pulses. 

’he  specific  two-channel  FLIR  configura- 
tion is  shown  in  figure  7.  It  is  observed 
that  the  edge  enhancer  is  eliminated  from  the 
background  channel  in  order  to  avoid  produc- 
ing an  unnatural  appearing  "sharpness"  in  the 
background. 


comparator  to  provide  the  "on-off,"  "blip" 
character  of  the  signal  returns.  The  elonga- 
tion in  the  azimuth  direction  can  be  readily 
simulated  with  a circulating  delay  line,  and 
the  "painting"  effect  of  the  scanning  phys- 
ical antenna  will  be  simulated  with  a special- 
purpose  circuit  synchronized  to  the  horizontal 
and  vertical  sync  signals,  figure  11  illus- 
trates the  two-channel  fLR  simulator. 

Synthetic  Aperture  R^ar_[SAR) 


Low-Li^ht-Level  Television  {Lj-LJVj 

Because  the  LLLTV  sensor  responds  to  the 
same  R(\)  as  the  vidicon,  no  distinction  need 
be  made  in  the  processor  between  target  and 
background  classes.  As  a result,  the  pre- 
ferred simulator  configuration  for  LLLTV  is 
the  single-channel  configuration.  For  the 
analog  simulator,  the  LLLTV  features  of  spe- 
cial interest  are  signal  "blooming"  and  the 
image-lag  effect.  Since  signal  "blooming"  is 
a result  of  saturation  in  the  final  display 
stage,  the  "saturation"  ZMN  in  the  LLLIV  sim- 
ulator must  be  positioned  at  the  last  stage 
after  the  noise  has  been  added  and  the  sig- 
nal has  been  processed  through  the  linear 
transfer  function.  The  linear  transfer  func- 
tion itself  will  be  a cascaded  pair  of  linear 
operations,  the  first  of  which  is  the  time 
invariant  modulation  transfer  function,  M(f), 
and  the  second  of  which  is  the  velocity  depen- 
dent image-lag  operation.  The  image-lag  oper- 
ation will  have  an  impulse  response  given  in 
figure  8 and  will  be  realized  with  a wideband 
video  delay  line  as  shown  in  figure  y. 


The  overall  single-cha.mel  LLLTV  simula- 
tion is  presented  in  figure  10. 

forward  Looking  Radar  (FLR) 

In  a typical  real  aperture  PPI  display 
the  targets  are  "blips"  against  a dark  back- 
ground and  are  narrow  in  the  range  direction 
but  wide  (beamwidth  times  range)  in  the  azi- 
muth direction.  Although  the  PPI  display  is 
clearly  the  appropriate  display  for  a polar 
coordinate-based  system,  any  coordinate  trans- 
formation from  the  rectangular  coordinate,  as 
raster  scan  to  the  PPI,  is  virtually  impossible 
for  an  analog  system  without  scan-to-scan  mem- 
ory. fortunately,  at  the  longer  slant  ranges, 
where  the  cueing  operation  is  desired,  slant 
range  is  about  the  same  over  the  entire  ground 
patch  and  the  coordinate  f,roblem  is  no  longer 
present,  permitting  the  direct  use  of  a rectan- 
gular scanned  CRT  display.  The  broad  flow  of 
a two-channel  FLR  simulator  is  to  selectively 
process  the  target/background  classes  on  the 
basis  of  their  ensemble  averaged  reflectivity 
coefficients,  R(A),  in  the  microwave  region, 
incorporating  through  an  edge-enhancer  the 
important  specular  return  nature  of  the  tar- 
get class.  Both  target  and  background  sig- 
nals will  be  Summed  and  then  fed  into  a video 


A synthetic  aperture  radar  simulation 
was  not  included  in  the  final  system  implemen- 
tation of  the  Visual  Sensor  Simulator.  How- 
ever, the  basic  circuitry  design  was  consid- 
ered as  described  below. 

As  with  the  FLR  sensor,  a two-channel  SAR 
configuration  would  simulate  the  microwave 
scene  reflectivity,  R(k),  with  dedicated 
target  and  background  ZMN's.  Edge  enhancers 
would  simulate  both  the  specular  nature  of 
the  scene  and  the  overall  effect  of  shadowing 
(the  edge-enhanced  simulation  of  shadowing  is 
quite  effective  provided  the  enhancer  has  a 
damped  oscillatory  (zero  crossing)  step  re- 
sponse). Figure  12  demonstrates  a typical 
SAR  configuration  where  the  final  M(f)  simu- 
lates the  IF  pass-band,  resulting  in  a lower- 
ing of  the  overall  sensor  resolution. 

CIRCUIT  FUNCTIONS 

The  hardware  implementation  of  the 
Visual  Sensor  Simulator  consolidated  the 
desired  circuit  functions,  system  interfaces, 
and  controls  into  the  physical  package  shown 
in  Figure  13. 

Ihe  desired  circuit  functions,  illus- 
trated in  the  block  diagram  (Figure  14),  are 
accomplished  by  utilizing  medium  speed  T^L, 
CMOS  logic  families  and  high-speed  analog  de- 
vices. Wherever  practical,  separate  circuit 
cards  were  utilized  for  each  type  of  sensor 
video,  processors  to  provide  independent  ad- 
justment and  modification  capability.  Cer- 
tain conrion  functions,  such  as  power,  sync 
and  noise  generation  which  are  utilized  in 
all  sensor  video  channels,  are  provided  from 
dedicated  circuit  cards.  Extensive  bypassing 
and  decoupling  is  utilized  on  the  power 
Supply  lines  to  prevent  instability  and  other 
anomalies  which  might  result  in  degradation 
of  the  Visual  Sensor  Simulator  performance. 

The  entire  simulator  is  housed  within  a 
standard  19-inch  rack  and  powered  by  120  VAC 
single-phase  CO  Hz  power.  Computer  control 
is  provided  by  optically  isolated  binary  ad- 
dress lines.  The  computer  interface  was  spe- 
cially designed  to  provide  a switchable  video 
output  Capability.  The  interface  circuit  pro- 
vides binary  decoding  and  the  necessary  video 
and  sync  switching. 
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Figure  7. 


Two-Channel  FLIR  Simulator 
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Figure  8.  Impulse  Response  of  Image-Lag  Simulator 


Figure  9.  Image  Smear  Circuit  Realization 
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Figure  10.  Single-Channel  LLLTV  Configuration 
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Figure  11.  Two-Channel  FLR  Configuration 


Figure  12.  SAR  Configuration 
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VISUAL  SfNSOR  SIMULAIOR 


Fir.urp  13.  Vi'-iial  Sensor  Simulator 
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The  video  input  circuitry  is  designed  to 
accept  nominal  1-volt  peak,  positive-going 
video  tor  operation  on  Jl,  J2  and  J3.  for 
operation  with  RUB  color  video,  all  three  in- 
put connectors  are  utilized. 

The  video  input  impedance  is  7b  ohms,  liut 
can  be  reconfigured  to  higher  impedance  by  re- 
moval of  input  termination  resistors  on  the 
video  buffer  card  A7 . If  operation  is  desired 
on  a black  and  white  input  video,  the  use  of 
input  connector  Jl  is  recommended. 

The  sync  input  is  designed  to  provide 
for  operation  with  composite  negative-goin<j 
sync  pulses  (standard).  The  sync  format  may 
be  either  bJ5,''60  (UA  Standard  RS170)  or 
6Jb/bO  ("Luropean  Standard").  The  negative- 


going sync  input  should  be  between  0.1  volts 
and  b.n  volts  peak  amplitude  for  proper 
operation . Operation  from  composite  video  is 
possible  if  adjustment  of  the  sync  offset 
control,  A6R2,  is  performed. 

Video  and  sync  ouputs  are  all  capable  of 
driving  a 50  foot  length  of  75  ohm  coax  cable 
correctly  terminated  at  1.0  volt  video  level 
with  less  than  10  percent  amplitude  roll-off 
measured  at  1 MHz.  lach  video  output  has 
a dedicated  video  buffer  amplifier. 

Figure  15  presents  an  example  of  the 
representative  imagery  generated  by  the  Vis- 
ua  1 Sensor  Simulator.  ihe  center  photo  shows 
the  original  scene  with  the  various  sensor 
simulations  shown  in  the  surrounding  photos. 
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figure  15.  Visual  Sensor  Simulation 
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CONCLUMONS. 

Tho  Visual  Sensor  Simulator  was  devel- 
oped as  a low-cost  solution  to  the  problem  of 
simulatiny  airborne  visual  sensors  for  pilot- 
in-the-loop  testing.  While  the  present  ver- 
sion was  found  to  be  highly  acceptable  for 
the  required  purpose,  it  was  recognised  that 
the  flexibility  of  the  analog  technique  would 
penint  the  development  of  additional  caiiabil- 
Uy.  As  IS  typical  of  research  and  develop- 
ment efforts,  the  available  funding  was  lim- 
ited. As  funds  do  become  available,  however, 
the  development  of  the  growth  potential  that 
is  anticipated  in  the  unit  is  planned.  As 
was  previously  noted,  the  present  version 


does  not  provide  a capability  for  target  iden- 
tification as  the  signal  processing  provides 
imagery  simulation  rather  than  target  signa- 
ture simulation.  Further  efforts  will  be 
made  to  improye  the  correlation  of  the  sim- 
ulated imagery  with  the  return  from  the  real 
world  electro-optical  sensor  and  to  evaluate 
the  degree  of  correlation  achieved  by  the 
simulation.  The  addition  of  radar  range 
rings,  controllable  target  designator  cursors 
and  other  capabilities  can  be  achieved  with 
additional  analog  circuits  and  the  use  of  dif- 
ferent cathode- ray  tube  scan  techniques. 

Some  of  the  proposed  additional  capabilities 
are  shown  in  Figure  16.  Further  development 
efforts  to  implement  these  improvements  are 
anticipated. 
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Figure  16.  Proposed  CKT  Display  Simulations 
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\!odels  characterizing  tiie  step  '■vise 
decreasing  failure  rate  associated  uith  the 
softv^are  debugging  process  are  applied  to 
a pa'^t  computer  program  development  in 
novel  uays.  In  these  applications,  the 
initial  number  of  errors  in  the  prograni, 
and  the  step  size  constant,  are  determined 
from,  the  error  detection  rates  observed 
during  an  initial  period  of  debugging,  t'or- 
r7.al  rr^ani pulation  of  maximum  likelihood 
equations  permits  estimation  of  debugging 
tinif  to  achieve  a code  with  specified  resid- 
ual error  content.  [in  any  sizeable  program 
it  is  impossible  to  remove  all  errors.] 

1 ntroduction  and  Model  Descriptions 

Specitying  and  achieving  fixed  levels  of 
software  reliability  is  a new  concept  in 
industry,  even  though  customers  have  been 
suffering  from  the  lack  of  it  for  over  two 
decades.  In  the  present  paper,  probability- 
based  models  describing  the  detection  rate  of 
errors  in  con.puter  software  are  used  to 
match  debugging  effort  to  [ simulation]  reli” 
ability  goals,  and  to  predict  when  a new 
operational  software  program  will  be  ready 
for  verification  testing.  The  objective  was 
to  rievelop  a prediction  technique  as  an  aid 
to  resource  conservation, 

A variety  of  theoretical  models  tor 
determining  the  nurrd/er  of  errors  remaining 
u*  a con.puter  prograni,  after  initial  debug- 
ging, have  appeared  in  the  literature.  The 
mam  theme  ot  this  paper  is  that,  conversely, 
the  det>ugging  resources  required  to  reach 
a fixed  residual  error  lesel  can  be  predicted 
using  the  san.c  rntidels.  The  model  con- 
stants are  determined  hy  studying  the  debug 
history  early  in  the  te«!l  and  integration 
pl.ase.  Oni  e a data  base  is  established  from 
previous  progran.s,  the  approach  permits 


estimation  of  debugging  time  before  any 
code  is  written,  and  allows  later  updating 
to  improve  the  accuracy  of  the  prediction 
when  functional  testing  begins. 

Two  models  were  selected  for  compari- 
son of  results: 

1)  The  de- eutrophication  process  of 
Jelinski  and  Moranda  [l] 

2)  Shooman's  macroscopic  approach 

[2] 

Both  are  quantitative  stochastic  models 
describing  the  time  pattern  of  occurrence  of 
errors  during  software  development.  The 
models  are  intended  to  apply  to  the  situation 
where  the  program  is  sufficiently  complete 
to  work  for  continuous  time  periods  between 
failures.  .\o  attempt  is  made  to  take  into 
account  the  internal  structure  of  a program, 
due  to  a scarcity  of  data  in  the  industry  re- 
lating individual  error  types  to  program 
structure.  Since  all  software  bugs  are 
treated  equally,  the  validity  of  model  output 
depends  on  considerable  averaging  in  a 
la  rge  program. 

Failure  rate  at  any  time  is  assumed  to 
he  proportional  to  the  current  error  content 
(number  of  remaining  errors)  of  the  tested 
program,  yielding  a step-wise  decreasing 
detection  rate,  with  the  times  between 
lailures  exponentially  distributed.  This  is 
justified  if  errors  are  detected  in  a random 
way;  caused,  for  example,  t>y  rare  comhi- 
lUitlons  ot  Input  data  and  path  traversals. 
The  rate  initially  is  proportional  to  the 
initial  errcri'  content,  denoted  by  .N.  Fach 
time  an  error  is  removed,  the  detection 
rate  is  de<>.  eased  by  a constant  amount, 
equal  to  the  step- size  ♦.  I'he  basic  model 
is  shown  in  Figure  I,  where  the  increasing 
tin  e lietween  lailures  is  intentionally 
indii-ated  by  spacing. 
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KIgurt?  1.  Software  Failure 

The  parameters  N and  «■  can  be  estimated 
from  a pair  of  equations  derived  by  appli 
cation  of  the  maximum  likelihood  principle 
As  shown  by  the  authors,  these  equations 
are: 

De- F-utrophication  Model 
(Jelinski-Moranda) 


n 

♦ = n 

NT  - 1 (i-  1)  X. 

i = l 

n 

= I ^ 1 

T 

i=I  N - (i-  1) 

X = time  between  the  (i-lst)  and  ith 

I 

detections 

n = number  of  observations  of  indepen- 
dent interval  lengths  X^,  X^, 

X 

n 

T = total  debugging  time  IX. 

N = number  of  errors  present  at  T=0, 
assumed  to  be  independent  of  T 
(i.  e.  , no  new  errors  added  during 
debugging) 

Macromodel 

(Shopman) 


(N-  A,  ) Tj  F (N-d^l 


■^1*  -^2 


N-  , 


N-  a. 


n^  ■ numlier  of  observations  in  function- 
al test  interval  Tj  (^2*  tlebug- 

ging  time  T|(T2) 

A]  (^2)  = total  number  of  errors  found  in 
program  by  debugging  time 
T,(  T.) 

Although  inese  equations  require  iterative 
solution,  they  normally  yield  superior  re- 
sults to  more  explicitly  definable  moment 
methods  of  parameter  estimation. 

Shopman's  equations  immediately  generalize 
to  n tests,  which,  if  unit-error  in  size 
(n.=  1 , T = X.)  brings  the  model  more  in 
J J J 

line  with  the  approach  of  Jelinski  and 
•Mo  randa ; 
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In  fact,  comparison  of  the  two  models 
showj  them  to  be  identical  if  a.  is  equal 
to  (j-1),  or  equivalently,  if  T = 

^ ( ) ^ 

1 X.  for  test  interval  T . 

. . I 1 


In  earlier  work  [3],  it  was  assumed, 
along  with  Shooman,  that  T.  was 
J 

“Xi 
i = l 


defined  as 
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Appli  i4tiot\s  to  Space  Shuttle 

a soltv'.ai'e  error  prediction  study 
‘1^  t).e  leliriski  Ntoranda  model  was  applied 
ti>  p<irtions  of  the  ''pa^  e shuttle  Main  l-^n^ine 
tauitroller  (on.puter  program  tc^  deterniii^e 
resifhial  error  coi’.ten.t  (N-nl  ot  certain 
modules.  Tne  authors  of  that  study  note^l 
•i.at  a decreasini:  detection  rate  was  not 
kienerallv  c l.a  r a < te  r i st  i c of  tlie  discontinuous 
erification  r:;o<]e  of  operation  tvpical  wit’n 
t:,e  '^i.uttle  pro^irani  de.elopment.  I'lie  rate 
ol  discovery  o’  errors  asso<'iated  with  a 
ph«ise  identified  as  Inte^jrated  System  Test 
Hrd  iISTHl,  di<l  however,  show  a redaction 
wilt*,  tim.e.  Since  successful  prediction  re- 
quired tl'.at  the  software  failure  rate  fall  off 
in  tii:  e,  effort  was  concentrated  on  a part  of 
tne  isril  proi^ran  , designated  the  Cyclinn 
pro^ran.,  which  promised  adequate  data. 

I • <*  tin  e period  spanned  by  testing  was 
roufcffiU  from  January  to  .^eptcnnher  1975, 

I he  author  of  this  report  recO)inized 
ir:at,  ':onversely,  a purely  formal  estimate 
of  tf.e  expected  tin'-e  to  debu^^  a program 
could  be  obtained  through  use  of  such  niodels. 

Referring  to  h'i^jure  I,  the  cumulative  num- 
ber of  errors  detected  in  the  Cycling  pro- 
tran.  is  plotted  vs,  debu^i^in^;  time. 


('ycliny  is  the  name  ^iven  to  the  major  and 
minor  cycle  executiv<*  routines  plus  thetr 
first  an<l  vSecond  level  subr-ujt  It 

does  not  include  ar^y  failure  brandies.  ‘This 
portion  is  traversed  every  ZO  rrh  I li  sf'cond  s , 
the  current  path  taken  heiny  rlete  rrr.i  ned  by 
input  conflitions.  The  proyrarr-.  contained 
4400  instructions,  and  a total  ot  '<0  software 
errors  were  found  during  the  t<*st  period 
from  lanuary  i 1 to  .1  urie  Z4.  I'‘ollowiny 
submission  of  the  Tune  24tli  version  of  the 
ISTli  pro^^ram,  six  additional  errors  in 
the  (^yclin^  proyran'  w-ere  identified  at  the 
National  Space  l echnolony  Laboratory 
INSTL)  prior  to  Aunust  19th,  1975. 

Sonie  care  rriust  he  taken  in  applying 
the  models  to  this  data,  if  erroneous  pre 
diction  is  to  be  minimized.  As  to  f)e 
expected,  the  beyinninj^  data  points  do  not 
tit  the  trend  of  most  of  the  data,  due  to 
starting  transients  in  the  delju^^iny  process. 
Otintting  the  first  5 data  points,  the  maxi- 
mum likelihood  equations  of  lelinski- 
Morarida  are  applied  over  the  55  points 
froni  t'ebruary  15  to  June  20  to  estimate 
N and  0 {corripare  the  technique  in  [5], 
where  N is  known).  The  equations  then 
predict  a 1'  of  I.  3 months  from  June  24th 
to  remove  all  but  3 errors  from  the  proyran., 
and  5,  0 nionths  to  achieve  a clean  code. 


2,  Software  Frrors  in  Space  Shuttle  Main 
Kn^inc  Controller  Cycling  Program 
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The  first  luitiilier  ayrres  well  with  what 
artuallv  happened  (it  was  estimated  from  the 
model  that  1 errors  remained  in  the  August 
I *th  ersionl.  The  second  niimfier  cannot  he 
ctiei.ked,  as  follow  up  data  of  that  nature 
from  NSI  1 is  not  available. 

I'i.e  ^fiooman  equations,  iislnit  two  test 
i lervals,  were  applied  to  different  parts  of 
t (’  test  uata,  with  widely  differing  results. 

1 '.e  first  application  was  over  unequal  inter 
■ als.  the  30  days  in  March,  and  the  ' 0 days 
in  .'Xpril  and  May,  This  led  to  an  N of  71, 
and  a predicted  value  I of  40  days  vs,  an 
actual  .f4  days  to  reach  the  ,'une  24th  level  of 
' 0 errors  corrected,  and  4,  H months  vs, 

2,  7 to  attain  the  .August  I'Uh  detection  status 
('  additional  errors  removed).  The  second 
application  utilized  the  first  20  days  of  .March, 
and  the  last  20  days  of  April  as  the  testing 
period.  That  predicted  an  N Of  t)7  and  a I 
of  4h  days  vs.  an  actual  30  days  to  reach  a 
point  where  7 errors  remained  in  the  pro- 
gram, and  118  days  vs,  110  actual  to 
remove  all  but  4 errors. 

Comments 

In  this  study  a look  was  taken  at  models  of 
software  reliability  growth,  specifically  with 
respect  to  evaluating  their  use  in  estimating 
debugging  time.  Two  models  were  selected 
for  application  that  seemed  to  stochastically 
describe  our  conceptual  idea  of  error  behav- 
ior during  development  testing. 

The  numerical  results  obtained  clearly 
indicate  sensitivity  to  both  the  testing  inter 
val  size  and  the  choice  of  test  points.  One 
of  the  tacit  assumptions  of  these  models  is 
that  the  exposure  rate  during  test  (reflecting 
both  manpower  and  intensity  of  testing)  is  the 
same  for  time  periods  of  equal  length.  This 
IS  seldom  the  case  in  reality,  and  adjust- 
ments have  to  be  made  when  applying  the 
models,  t-.xposure  rate  is  in  some  manner 
embedded  in  the  debug  history,  and  in  the 
application  of  the  model  equations,  is  aver 
aged  out  in  various  ways.  A normal  exposure 
can  be  defined  in  terms  of  the  specific 
problem  at  fiand,  or  one  may  attempt  to 
choose  the  testing  intervals  and  test  points 
to  minimize  the  effects  of  variable  exposure, 
as  was  done  in  the  present  case  (albeit  in 
hindsight). 


In  applying  the  I el  ins  ki  - .Mo  randa  equations  , 
it  was  found  that  the  estimates  for  N were 
generally  a little  low,  leading  to  debugging 
time  estiii  ates  that  were  on  tlie  low  side. 

This  may  be  due  to  the  model's  'folding  in," 
rather  than  directly  subtracting,  succeeding 
data  points.  If  an  N of  70  had  been  estimated 
at  the  lune  24tli  point,  the  estimate  f would 
ha^■e  ijeen  1,7  ri.onths  to  remove  n more 
errors,  and  3.8  montlis  to  an  error-free 
program. 

Application  of  the  Shooman  equations 
to  only  two  test  intervals  seemed  to  high- 
light the  lariable  exposure  a program  gets 
during  debugging.  Kxtending  the  method  to 
more  tests  should  minimize  these  effects, 
and  firing  the  results  closer  in  agreement 
with  the  I e lins  ki  - Mo  randa  predictions. 

It  is  probable  that  a more  precise 
model  of  program  structure,  and  the 
debugging  process,  will  be  required  to 
improve  predictive  results. 
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SIGNALING  TONE  SIMULATION  IN  AN  IMERGING  COMMUNICATIONS  SYSTEM 
IMPLICATIONS  rOR  TRAINING  AND  UTILIZATION 
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US  Army  Human  Enqineerinq  Laboratory 


SUMMARY 

The  implications  of  early  simulation  of 
emerqent  electronics  systems  are  discussed. 

■^he  effect  of  simulation  on  training  programs 
and  system  usage  in  the  field  are  illustrated 
by  a recent  experiment  involving  a new  mili- 
tary cotmunications  system.  Potential 
savings  in  money  and  time  are  identified,  as 
well  as  increased  system  effectiveness  as  a 
result  of  early  system  evaluation.  Early 
simulation  is  shown  to  significantly  contrib- 
ute to:  (1)  more  cost  effective  training; 

(?)  identification  of  problem  areas  within 
the  system;  (3)  a realistic  appraisal  of 
System  performance;  (A)  possible  improvement 
of  overall  system  effectiveness;  and  (5) 
savings  in  time  throughout  the  systems  life 
Cycle. 

The  purpose  of  some  aspects  of  training 
is,  unfortunately,  too  often  seen  as  a remed- 
ial effort  to  teach  someone  how  to  use  a piece 
of  equipment  or  a system  which  should  not  have 
been  fielded  in  the  first  place  (at  least  in 
its  present  form).  No  matter  how  cost  effec- 
tive the  training  process  becomes,  it  cannot 
produce  shilled  personnel  if  the  systems  they 
are  to  work  with  are  too  complicated  for 
anybody  to  ever  use  them  effectively.  As 
General  John  J.  Hennessey  said  in  Signal 
‘^agazine  (March  77  issue)  "Too  often  we  dis- 
cover that  the  success  of  the  tactical 
system  is  the  result  of  the  extraordinary 
effort  of  Our  dedicated  nien  and  women  over- 
coming, rather  than  being  aided  by,  their 
equipment."  It's  a case  of  "if  you're  not 
part  of  the  solution,  you're  part  of  the 
problem"  and  in  order  to  get  maximum  benefit 
from,  the  problem  of  equipment,  the  ideal 
situation  would  be  to  have  a minimum  amount 
of  complex  things  to  teach. 

However,  as  we're  all  aware,  it's  seldom 
so. 

Tasks  in  the  "Age  of  Electronics"  are 
becoming  more  intricate  with  each  new  item  of 
egui;jment,  and  the  total  effect  of  this  trend 
is  certainly  not  likely  to  make  training 
people  in  the  future  any  easier.  What  I 
would  like  to  demonstrate  here  is  a way  in 
which  early  simulation  of  new  systems  can  be 
used  to  substantially  reduce  training  prob- 
lems and  increase  effectiveness  of  the  user 
and  the  system.  As  an  example,  I will  use  a 
study  in  which  early  simulation  of  the 


signaling  tones  to  be  used  in  a new  tri- 
service tactical  telephone  system  was  exam- 
ined. Through  electronic  simulation  of  the 
"real-world"  way  in  which  tnis  system  was  to 
be  used,  not  only  was  a significantly  earlier 
evaluation  of  this  system  possible  but  also 
potential  training  aids,  possible  problems, 
and  their  effects  on  user  performance  could 
be  compared. 

What  emerged  from  the  study  were  five  key 
i ssues : 

1 . Cost  effective  training  begins  in 
early  system  development  - in  otner  wcrds, 
system  development  should  interact  with 
user  training  and  doctrine  reouiroments  to 
produce  a system  with  the  fewest  possible 
training  proDlems. 

2.  Early  simulation  can  identify  potential 
areas  of  concern  in  terms  of  training  and 
use  - the  cost  of  early  simulation  can  be 
more  than  recovered  in  terms  of  permitting 
extra  lead  time  for  designing  training 
methods  and  procedures  to  deal  with  learning 
the  system,  rather  than  having  to  "patch  up" 
an  inappropriate  procedure  or  training  aid. 

3.  Simulation  User  Input  = Realistic 
Appraisal  - too  often  the  constraints  of  the 
system  development  process  prevent  an 
accurate  assessment  of  the  best  way  to  show 
someone  how  to  use  it.  Simulating  use  with 
actual  military  personnel  allows  formation 
of  a more  accurate  picture  of  the  learning 
process  and  can  lead  to  development  of  a 
realistic  method  for  teaching  military  users. 

4 . HFE  * Training  - System  Effectiveness  - 
if  Human  factors  Engineering  (to  provide  an 
easily  used  system  capable  of  quickly  and 
efficiently  performing  its  function)  can  be 
combined  with  proper  training  for  the  user 

to  perform  those  tasks  necessary  to  operate 
the  system,  the  result  will  more  than  justify 
the  effort  involved. 

5.  Time,  the  Irreplaceable  Resource  - "'’he 
most  valuaBle  resource  to  be  saved  through 
parly  simulation  is  time.  Growth  in  life 
cycle  costs  increases  tremendously  in  the 
later  stages  of  system  development  and  de- 
ployment. A minor  correction  on  an  earlier 
prototype  (or,  most  effectively,  on  a blue- 
print) could  result  in  saving  truly  stag- 
gering sums  of  money  as  well  as  considerably 
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increasing  the  value  of  the  system  to  the 
nation's  defense  effort.  No  resource  is  as 
critical  (or  as  p»t'Pnsive)  as  tine,  and  if 
a simulation  device  can  be  used  in  place  of 
an  enormously  evpensive  and  sometimes  not 
yet  fielded  piece  of  equipment  to  take  an 
early  look  at  a system,  so  much  the  better. 

As  an  example,  a nt-w  OOP  communications 
system  is  being  produced  which  uses  signaling 
tones  during  a telephone  call  to  indicate  to 
the  user  the  status  of  his  call.  This  system 
has  m.any  of  the  familiar  tones  such  as  dial 
tone,  ringback,  and  busy  signal,  and  it  also 
has  a number  of  unique  tones  associated  with 
various  calling  features  such  as  multiple 
conferencing,  call  transfer  and  nonsecure 
warning  tone.  As  new  features  were  added  to 
this  system,  the  tota’  number  of  tones  that 
could  be  presented  to  the  user  during  a call 
reached  16.  As  an  aside,  it  should  be  added 
that  this  is  not  a unique  example  within  the 
field  of  comunications,  but  rather  it  is 
typical  of  current  trends  among  many  elec- 
tronics nenufacturers  - reflecting  in- 
creasing system  complexity  with  increasing 
interface  complexity,  a consequence  which 
need  not  and  indeed  should  not  follow. 

In  order  to  take  an  in-depth  look  at  this 
system,  it  was  necessary  to  construct  a 
simulation  device  which  could  deliver  the 
correct  tones  during  an  actual  telephone  call 
situation.  Due  to  the  astronomical  cost  of 
the  digital  switching  system  itself,  as  well 


as  the  logistics  problems  involved  in  tying 
up  a system  which  had  not  yet  been  completely 
finished,  simulation  was  an  inexpensive  means 
to  provide  a test  vehicle  for  evaluation. 

The  principal  apparatus  used  in  this  study 
is  illustrated  in  Figure  1. 

This  apparatus  was  built  using  common 
pooled  equipment  from  an  electronics  shop 
which  services  the  various  directorates  of 
our  laboratory.  A minimum  of  new  construc- 
tion was  made,  in  an  effort  to  keep  costs 
of  the  final  system  as  low  as  possible. 

Since  the  new  digital  system  will  re- 
place an  existing  analog  set-up,  it  was  also 
necessary  to  simulate  the  current  analog 
System  in  order  to  obtain  some  idea  of  what 
difficulties  would  be  encountered  during  the 
period  of  transition  - i.e.,  for  a consider- 
able time,  while  the  new  systems  are  being 
fielded,  subscribers  may  have  to  deal  with 
both  sets  of  signaling  tones  (analog  and 
digital ), 

The  signaling  tones  were  stored  on  a 
Honeywell  Model  5600B  14-channel  analog  data 
recorder,  which  was  used  in  the  playback  mode 
during  testing.  Each  participant  used  a 
TA-341  telephone  set  to  initiate  and  receive 
simulated  calls.  Although  the  tones  were 
presented  to  the  participants  on  a self- 
initiated  basis,  the  actual  tones  to  be 
presented  were  controlled  by  the  experimenter 
through  the  use  of  the  Tone  Controller 


HONEYWELL  14  CHANNEL  HECOHDER 


rONE  CONTROILER 


TA  341  TELEPHONE 


Figure  1.  Principal  Apparatus 
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tures  as  call  transfer  dial  tone  (sitoatior 
nun>t)er  IR),  broadcast  conference  notification 
tone  (15)  and  others  as  noted. 


(selector)  1.  For  example,  the  participants 
were  told  to  initiate  a call  to  telephone 
number  601.  The  experimenter  would  set  the 
"hook  circuit  switch"  to  Channel  No.  1 and 
the  "key  circuit  switch"  to  Channel  No.  4.  The  Phase  I test  period  was  concerned 

with  acquisition  of  initial  proficiency,  and 

As  each  participant  went  off  hook,  an  identification  of  the  siqnalinq  system's 

electronically  operated  switch  in  the  Tone  problem  areas.  The  Phase  II  test  oeriod  was 

Selector  closed  the  "hook  circuit,"  which  purposely  scheduled  after  ^ lonq  piriod  where 

played  back  a continuous  425-Hz  tone  (dial  the  participants  received  practice  and/or 

tone)  into  the  participants'  headset  re-  training  related  to  the  st  . This  was  in 

ceiver.  The  participant  then  keyed  in  the  order  to  address  the  question  of  how  long  the 

digits  601.  The  keying  of  digit  "6"  caused  participants  would  retain  their  proficiency, 

the  "hook  circuit"  to  open,  cancelling  the 

dial  tone.  Keying  the  digit  "1"  closed  the  The  two  test  periods  were  structured 

"key  circuit,"  which  played  back  570  Hz,  ? similarly;  first  testing  on  the  two  basic 

seconds  on,  4 seconds  off  (normal  ringback  conditions,  then  on  the  two  full-service  con- 
tone). Replacing  the  receiver  on  its  cradle  ditions.  One  of  the  two  participant  groups 

Opened  the  key  channel,  cancelling  the  ring-  was  assigned  to  analog  test  conditions  only, 

back  tone.  the  other  to  digital  test  conditions  only. 

The  resulting  arrangement  simulated  sub- 

The  study  was  divided  into  two  test  periods  scribers  first  being  subjected  to  the  basic 

(Phase  I and  Phase  II)  separated  by  a 30-day  tone  situations  and  later,  after  having 

rest  period.  The  general  test  procedure  is  gained  experience  with  the  system,  moving  on 

illustrated  in  Figure  ?.  to  use  the  ♦'ull  services  on  the  same  tele- 

phone instrument  (analog  or  ligitz'').  This 
The  "basic"  conditions  were  those  which  test  design  was  considered  realistic  for  the 

the  user  would  encounter  during  a normal  full-service  subscriber  who  would  first 

call.  As  indicated  in  Figures  3 and  4,  familiarize  himself  with  the  basic  services 

these  include  such  things  as  dial  tone,  ring-  before  attempting  to  use  any  of  the  more 

back  and  busy  signals.  The  "full  service"  sophisticated  features.  The  test  design 

conditions  utilized  the  full  capabilities  of  also  allowed  for  isolating  and  evaluating  how 

i.  the  system  and  included  tones  for  such  fea-  well  subscribers  would  use  the  basic  ser- 

' vices. 


Twelve  military  personnel  (five  offi- 
cers, seven  enlisted)  from  the  4?d  Trans- 
portation Pn,  Ft.  Meade,  MD,  participated  in 
this  study.  Due  to  the  nature  of  the  study, 
it  was  necessary  that  the  participants  have 
normal  hearing  and  tone  acuity.  Since  in- 
telligence scores  were  needed  for  purposes  of 
possible  correlation  with  speed  and  ease  of 
learning,  each  participant  was  given  the 
Otis  Quick-Scoring  Mental  Ability  Test  (high 
school.  Form  A).  The  range  of  IQ  scores  was 
8?  through  12A  (mean  IQ  was  107).  The 
participants  were  matched  by  tested  10  level 
and  randomly  assigned  to  either  analog  or 
digital  conditions. 

The  procedure  followed  for  each  simu- 
lated call  in  the  test  runs  was  basically  the 
same.  The  participants  were  directed  to 
place  or  respond  to  some  specific  simulated 
call.  They  were  given  the  opportunity  to 
review  the  abbreviated  and/or  detailed 
written  instructions  on  the  cal  1-processing 
features.  During  the  call  process,  the 
participants  would  receive  a signaling  tone. 
At  this  point,  they  would  choose  an  answer 
from  their  list  of  possible  answers  and  nark 
it  on  their  answer  sheets.  After  all  partic- 
ipants had  put  down  their  answers,  the  ex- 
perimenter told  them  the  best  answer.  This 
fon"  of  reinforcement  was  considered  analo- 
gous to  the  "experienced-user  advice"  usually 
available  to  the  novice  subscriber.  After 
all  discussion  on  the  "best  answer"  was 
Completed,  the  participants  would  wait  for 
further  instructions  from  the  experimenter. 

Three  levels  of  response  quality  were 
used  to  allow  the  participarts  to  express 
incremental  advances  in  learning.  The  three 
levels  were  defined  as  follows: 

Level  One:  acceptable  but  less-than- 
satisfactory  responses.  At  this  level  a 
correct  response  demonstrated  that  the 
participant  knew  the  correct  basic  reaction 
to  a tone,  but  had  no  real  understanding  of 
its  meaning  (e.g.,  hang  up,  but  you're  not 
sure  why). 

Level  Two:  satisfactory  responses.  At 
this  level,  a correct  response  demonstrated 
that  the  participant  knew  the  correct  tone 
reaction  and  its  general  meaning  (hang 
up  ...  something  is  busy  — either  the  line, 
the  trunks  or  the  special  service  requested  - 
you  don't  know  which). 

Level  Three:  rore-than-sati sf actory 
responses.  A correct  response  at  this  level 
showed  that  the  participant  also  understood 
some  of  the  signaling-system  nuances  that 
were  not  crucial  to  subscriber  effectiveness, 
but  which  were  beneficial.  (Hang  up  ...  the 
nuri*>er  called  (line)  1s  busy.) 


For  both  analog  and  digital  conditions, 
participants  showed  a significant  degradation 
in  performance  when  transitioning  from  basic 
to  full-service  levels.  IQ  was  highly  rorre- 
''ated  with  the  nunt)er  of  'rials  to  reach 
criterion  at  each  level;  a higher  score  on 
the  general  intelligence  test  indicated  that 
fewer  trials  would  he  needed  to  reach  crite- 
rion. Certain  tone  conditions  demonstrated 
noticeable  deviation  from,  the  mean  Ol)  and 
were  tentatively  identified  as  presenting 
obstacles  to  complete  mastery  of  the  system. 

As  can  tie  seen  in  Figures  1 and  A,  the 
participants  had  difficulty  with  certain  of 
the  tone  situations  involved  in  each  of  the 
conditions. 

As  the  number  of  tones  and  tone  situa- 
tions increased  from  basic  to  full-service, 
participants  experienced  difficulty  not  only 
in  learning  new  tones,  but  also  in  retaining 
previously  learned  material.  This  inhibition 
to  learning  was  greater  for  certain  tones  and 
tone  combinations. 

In  Figure  A,  for  example,  the  preempt 
tone  in  the  basic  digital  (RD)  condition  re- 
quired 11  trials  before  the  participants 
reached  criterion.  In  the  full-service  digi- 
tal (FD)  condition,  the  nonr.al  time  to  reach 
a level -two  response  criterion  for  the  same 
tone  was  only  twe  trials;  however,  during  a 
conference  call  (situation  ?2 ) it  required  11 
trials  before  'he  participants  learned  to 
differentiate  between  the  preempt  tone  and 
an  alternative  possibility  (situation  20, 
conferee  disconnect).  The  preempt  tone  is  a 
11, -second  burst  of  AAO/620  Hy  dual  tone, 
while  conferee  disconnect  consists  of  a 
1-second  burst  of  dual  A80/620  Hz  tone,  only 
a AO  Hz  difference.  Conferee  disconnect  tone 
was  rated  as  one  of  the  three  most  difficult 
tones  by  10  out  of  the  11  participants  who 
completed  the  questionnaires  at  the  end  of 
Phase  II  testing. 

Another  situation  of  concern  to  the 
participants  was  the  1-second  duration  of  the 
conference-notification  tones.  Because  the 
tones  are  presented  immediately  as  the  re- 
ceiver is  lifted  off-hook,  the  participants 
frequently  noted  that,  unless  they  put  the 
receivers  'o  their  ears  while  still  holding 
down  the  interlock  device  on  top  of  the 
phone  and  then  lifted  their  fingers  from  the 
phone,  it  was  very  difficult  to  hear  a suffi- 
cient amount  of  the  tone  to  discern  whether 
it  was  a preprogranwed- -conference  or  broad- 
cast-conference notification  tone.  Since  it 
is  unlikely  that  this  will  become  standard 
operational  procedure  for  answering  the 
telephone,  it  is  apparent  that  some  modifi- 
cations was  called  for  in  the  area. 


Uritten  instructions  were  presented  in 
two  fon'’s,  .1  one-pane  set  of  brief  instruc- 
tions which  (jave  only  a rinimal  description 
of  call  processinq  inforration,  and  a de- 
tailed set  which  nave  elaborated  instructions 
Lombined  with  a narrative  description  of  the 
Crpouency  and  cycling  rate  of  the  tones  in- 
volved. 

Of  the  11  participants  who  conpleted  tne 
questionnaire,  ‘'ive  preferred  the  abbreviated 
i nstruc* ions . and  six  preferred  the  detailed 
i nstruct lOi  ' . The  laci  of  clear  preference, 
cont'ined  witt  the  length  of  time  retjuired  *o 
raster  the  i .5ervi ce  conditions,  tends  to 
suggest  that  neither  version  is  particularly 


effective  in  transmitting  the  needed  informa- 
tion, It  can  be  anticipated  that  the  more 
traditional  type  of  written  instruction,  such 
as  was  used  in  this  study,  will  probably  be 
at  least  somewhat  inadequate  to  the  task  of 
teaching  the  new  subscriber  how  to  use  the 
system. 

In  general,  the  study  served  to  illus- 
trate the  importance  of  early  simulation  of 
complex  systems  as  a method  for  realistic 
evaluation  and  remediation.  In  terms  of  the 
hey  issues  raised  earlier: 

(1)  Cost  effective  training  - early 
simulation  o*'  this  system  permitted  the 


TRIAIS  TO  criterion  BV  TONES 


Figure  3.  Trials  to  criterion  by  tones--analog  conditions 
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develoirpnt  of  a relatively  inexpensive 
training  device  which  can  be  modified  and 
improved  for  use  with  this  and  other  systems. 
Requests  have  already  come  in  from  Army 
traininy  facilities  for  information  about 
this  device.  By  extending  the  lead-time 
for  producing  a training  aid,  significant 
increases  in  quality  and  effectiveness  can 
be  gained. 

( 2 ) Identifying  potential  areas  of  con- 
cern - proFTems  of  complexity  and  training 
methodology  emerged  much  earlier  than  they 
would  have  without  simulation.  This  will 
permit  the  expenditure  of  extra  remedi ational 
efforts  in  those  areas  where  they  will  do  the 


most  good.  Hopefully,  a combination  of 
system  "fixes,"  combined  with  development  of 
more  effective  aids  to  learning  the  system 
(e.g.,  perhaps  flow-charting  the  instruc- 
tions), will  result  in  the  fielding  of  a 
System  which  is  "part  of  the  solution"  to 
reducing  the  complexify  of  the  military 
electronics  environment. 

(3)  Realistic  appraisal  - use  of  mili- 
tary participants  in  a simulated  operational 
exercise  was  essential.  Too  often,  systems 
are  evaluated  by  the  engineers  who  built  them 
and  the  government  representatives  who  helped 
nxinitor  the  design  and  fabrication  process. 
It's  like  trying  to  proofread  a term  paper 
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SUBJECT  TA-341  TELEPHONE  SET 


gure  5.  General  apparatus  arrangement 


CONDITIONS 


Figure  6.  Trials  to  criterion  as  a function  of  coiutition 
and  level  of  t rea tmen t - - Pha se  I and  II 
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that  took  months  to  research  and  write  - you 
tend  to  fail  to  perceive  what  will  oo  through 
the  rind  of  the  naive  reader,  and  yo'i  fre- 
quently omit  information  which  is  well-known 
to  you  but  unknown  to  the  reader.  Similarly, 
engineers  and  scientists  quite  often  forget 
that  the  majority  of  eventual  users  of  their 
products  are  interested  in  the  device  as  a 
means  to  accomplish  a mission,  rather  than 
an  end  product  in  itself.  If  vou  need  a jeep 
to  get  through  the  mud,  a Rolls-Royce  will  be 
oh  little  value  even  if  it  is  a much  more 
mechanically  sophisticated  example  of  the 
genre. 

{‘1)  System  effectiveness  - early  simu- 
lation of  emerqent  systems  can  result  in  a 
more  ehfective  program  of  training  and  utili- 
zation. r.ood  human  factors  input  and  de- 
velopment oh  appropriate  training  aids  can 
combine  to  make  the  man-machine  interface 
with  a new  system  a pleasure  instead  of  a 
chore.  And  a system  that's  easy  to  under- 


stand and  use  in  peacetime  conditions  will 
be  an  absolute  asset  in  times  of  conflict. 

(5)  Time  - to  be  used  effectively,  the 
resource  of  time  requires  that  a system  and 
its  interaction  in  a realistic  environment 
with  the  user  be  examine^ as  eaTTv  as 
possible. 

In  summary,  time  ■ ar  •■M’t.her  be  created 
nor  destroyed,  it  can  only  be  spent  produc- 
tively, It  is  my  intent  in  having  presented 
this  analysis  to  illustrate  a use  of  simula- 
tion devices  which  permits  the  most  effective 
"spending"  of  this  most  valuable  resource. 
Through  a combination  of  qood  human  hectors 
input  during  development,  early  simulation, 
and  effective  training  procedures,  maximum 
value  will  be  obtained  in  terms  of  the  re- 
sources expended. 

Simulation  can  be  more  than  a training 
methodology  - it  can  be  an  invaluable  re- 
source in  itself. 
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c<’ns<‘r./t  our  vulu.iblf  ro  sourer  s -irr  now  .ivuil 
<ib  Ir . Truininq  sonar  ripor.itors  on  roal-tlmr 
simulation  rquiprnmt  In  a q round  “based  school 
is  on<*  such  application.  Recent  advances  In 
err-put  at  i ona  I and  stt^raqe  hardware  have  made 
it  possible  to  produce  coniplex  siqnals  in 
real 'tine  to  sinulate  the  diverse  sounds 
that  are  picked  up  by  hydrophones  in  sonar 
systems.  Early  sonar  simulation  systems  had 
to  produce  audio  sounds  that  imit.ite  those 
heard  throuqh  the  sonar  headphones  as 
received  from  ihr*  real  world  t-nv  i ronmen  t . 
Throuqh  .idvancement  s in  sonar  and  siqnal 
processinq  f»fhnoloqy,  the  Fourier  spectrum 
of  reci'ived  acfiustic  signals  are  also  dis- 
playetl.  A viable  simulation  trainer  must, 
therefore,  follow  suit  and  produce  stimuli  to 
the  student  that  must  not  only  "sound”  riqht, 
but  also  have  the  same  salient  spectral 
features  as  the  acoustic  siqnals  received  by 
sonar  hydro{)hone  arrays  in  the  real  world. 

Modern  sonar  simulation  trainer  systems 
havi-  be<*n  bfiundetl  hy  two  philosophies  of 
design  ccif’wnonly  referred  to  as  "simulation" 
and  "s  t i mu  1 a t i on . “ "S  imu  I a t i f)n"  systems 
f»K)d«']  ev<*rythinfj  in  the  rtal  world  to  produce 
siqnals  to  drive  meters,  cathode-ray  tubes 
(CRT)  and  earphoru's  tfiat  would  imitate  every- 
thinq  that  a sonarman  would  expect  to  see  and 
hear  in  an  ac t ua  1 op<‘ rat  i on.i  1 sonar  suite. 

No  actual  <jper.il  ion.il  sonar  equipment  is 
used.  A "stimulator"  on  the  other  hand  uses 
ojM'rational  son.ir  equipment  .ind  real-time 
model  inq  technigu<‘s  to  qi*nerate  signals  that 
wf>uld  simulate  signals  normally  received  by 
such  o<iuipmef>l.  The  principal  difference 
between  t h«*  two  extr€‘m»*s  lies  in  whether  or 
not  the  operational  equipment  effects  are 
modeled.  For  «iny  i v»  n system,  the  approach 
chosen  can  stronr|ly  impact  the  cost  of  the 
system  and  the  ultimate  realism  of  the 
siriulatlon.  It  is  not  always  a clear-cut 
decision  at  the  outset  as  to  whether  one  or 
the  other  approach  is  nK)re  economical,  or 
e/en  possible.  Often  a mixture  produces  the 


best  soltitlon.  Hov/evei,  i «•  nethi^d  fin. illy 
used  are  of  t er»  dir.faf»-d  by  constraints  placed 
on  the  de*.  iqner',  b,  th<-  cus(f>nu'r. 

Ff)r  those  whf)se  interest  in  sfjnar  simu- 
lation is  recent,  this  papc*r  can  be  read  as 
a sequel  to  an  earlier  papt‘r  by  Wang  |1| 
whore  a synopsis  of  the  necessary  sonar  and 
trainer  bacFqrf)iind  information  is  presented. 
Only  some  facets  of  this  background  informa- 
I Ion  Is  pre'.ente«l  in  »his  paper  for  complete- 
ness . 

This  paper  di<, cusses  s^rie  real-time 
sonar  siqnal  generation  methods  and  shows  how 
son<‘  of  these  signals  can  be  analysed  to 
determine  their  sp<‘Ctrum.  The  need  to 
analyze  the  spectral  nature  of  these  siqnals 
lies  in  the  fact  that  for  the  sake  of  stabil- 
ity, repoatab i 1 i ty , reliability  and  economy, 
digital  methods  are  used  to  synthesize  the 
siqnals.  However,  to  reproduce  the  siqnals 
that  drive  the  actual  displays,  these  signals 
must  eventually  be  converted  to  .3n  analoq 
form.  Again,  for  the  above  ment ioned  advan- 
tages of  digital  signalling,  the  process  of 
merging  these  siqnals  are  often  held  off  to 
the  last,  most  reasonable,  part  of  the 
processing  pip<*]ine.  This  would  sometimes 
require  successive  sampling  of  inti-rpolat  ed 
siqnals  which  then  destroys  the  constraints 
of  Nyguist's  sampling  theorem.  But  since  the 
spectrum  of  the  composite  signals  are 
ev(‘ntually  analyzed  and  electronically  dis- 
played for  source  signature  identification, 
the  effects  of  the  various  intermediate 
processing  steps  on  the  spectrum  of  the 
ultimate  signal  becomes  vt»ry  imjKirtant. 

It  is  obvious  that  synthesizing  sonar 
signals  in  the  spectral  dfvnain  is  possible 
and  even  desirable  in  srxm^  instances.  How- 
ever, the  pros  and  cons  of  time-domain  versus 
sp(‘C  I ra  1 -d(3ma  i n synthesis  techniques  will  not 
be  addressed  in  this  papt'r.  Instead,  dis- 
cussions will  only  concentrate  on  the  former 
means  of  acoustic  signal  synthesis. 

DIVERSITY  OF  SOUNDS 

Sounds  th«it  contribute  to  the  cofnposite 
signal  picked  up  by  a hydrophone  array  can  be 
broadly  classified  into  three  groups  as 
noises  caused  hy  water  movement,  by  marine 
life,  and  by  man-made  sources.  To  provide  an 
appreciation  for  the  diversity  encountered, 
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'•  Aniplitudf  Sp«  t I ru''  of  W.itrr  N'ji'.t 


f.K.h  cl.iss  (»f  n^i  i r r will  fjc  discussed 

h r I »■  M y . 

Noise  lieneruted  by  o.iler  movertent  has 
h»M*n  '’M'Usurrd  by  - >ny  research  l<*ams  under  .) 

♦fifty  of  conditions  at  nunierous  locations, 
fiuufe  I show*,  an  averarje  spectr.j  of  water- 
nf)Vf  ent  - f t I .Kf d undfrw.iter  sound,  as  a 
♦unction  of  SfO  slate,  which  is  cormon  1 y 
-'fasufed  in  terms  of  wave  heiqht.  (t  is 
interest  intj  to  note  that  the  spectrum  is  not 
flat,  but  falls  with  rising  frequency.  The 
nini"'ur'  water  noise  can  be  titiributed  to 
inherent  thermal  nolsr*  in  the  water  and  to 
the  motion  of  general  marine  life  present  in 
the  environment.  This  minimum  is  rarely 
exceeded  in  .ictual  measurement  s . The  origin 
of  noise  due  to  w.ilrr  oK^vement  ranges  from 
water  splashing  on  foreign  otjjects,  sucf*  as  a 
shoreline  and  the  hull  of  a ship,  to  the 
ir’ipact  of  water  on  water  as  in  breaking  of 
w.ive  crests.  Other  examples  of  noise  due  to 
wafer  rnovemenl  can  be  frtund  in  the  literature 
on  sonars  1 2 | . 

Marine  life  of  all  types  also  contrib- 
utes to  the  general  noises  found  in  the 
ocean.  M«iny  marine  creatures  emit  sounds 
that  have  charac ter  1 st i c signatures.  The 
toad  fish  is  one  which  emits  a loud  sound, 
much  like  a violin  string  stroked  by  a bow. 


Others,  lik*  the  p«-rpr.;.,-,  produce  ’-UCh  .♦ 
varirlv  of  sounds  that  il  is  usel«'S‘-  to  t r-. 
to  Idenii^v  itie*'.  for  Instance,  the  porpoi-bO 
is  knrtwn  to  burl*  lik**  dog,  gobble  Ilk*  a 
turkey  and  Sfx’ietir*  e'-ill  a dl  >tincliv»- 
bubhlinfj  whist  l>  . Tapre  .ire  '>lh*  r -ai  ine 
inhabitants  that  produce  practically 
i mpe  rcept  i b 1 *•  sounds  that  tu'cc-xno  annoyingly 
audible  only  when  hufje  number^  of  them  are 
active  *it  the  same  fl-se.  Two  such  creatures 
are  the  snappin*!  shrimp  and  a small  fish 
called  th<‘  croal-er.  Noise  generated  by  this 
last  group  of  nolsemakors  is  both  s«'isonal 
<ind  I or  .♦  1 i I y -bound  . 

The  principal  source  of  man-made  noise 
in  the  open  seas  is  shipping.  Sounds  frwi  a 
given  ship  depend  on  its  type,  si/e,  iU*sign, 
and  mode  of  operation.  The  sound  actu.iMy 
received  by  a hydrophone  depends  on  the  depth 
and  temperature  profile  of  flu-  oc<*an,  as  well 
as  the  relative  location  of  the  ship  emlttiiu) 
the  sounds  to  the  hydrophones  picking  them 
up.  However,  the  sounds  emitted  by  ships  are 
very  distinctive,  and  are  effectively  used  to 
identify  the  source.  A trainer,  therefore, 
must  duplicate  shipping  sounds  to  such  a 
degree  of  exactness  that  a student  will  be 
able  to  transfer  the  knowledge  he  gains  from 
the  trainer  to  the  operational  world.  This 
usually  means  a reasonably  faithful 
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rt*  prtxKic  t i on  of  both  thn  sound  w.ivofnrm  .mcl 
its  s pfc  t r a . 

The*  s{M'cfr<il  Invnl  of  shipping  nois#» 
vines  not  differ  much  from  general  water  noiso, 
♦'KCnpf  for  a sleep«*i  negative  s1o(m*  and  the 
man i f es t a t i on  of  distinct  peaks.  Engine  and 
propeller  noises  produce  cfiarac  t e r I s t i c 
frequencies,  with  the  latter  being  c^iripli- 
cated  by  such  factors  as  cavitation  |3l, 
'nechanicaf  vibration  and  singinc)  (2|,  all 
resulting  in  a complex  modulation  of  Ifie 
basic  noise. 

Thf  purptise  of  this  discussion  is  to 
point  out  f h»*  wide  range  of  noise  sources,  and 
types  and  effects  that  a trainer  must  produce 
to  provide  necessary  training  cues  and  a 
"realistic"  effect.  The  very  breadth  of 
character  i St  i cs  th.it  need  to  be  modeled 
require  a par.ir*<*t  r ic  sound  gource  that  will 
produce  .1  proper  coeiposite  signal.  Methods 
to  synthesize  and  analyze  such  signals  will 
be  the  topic  for  the  rest  of  (his  paper. 

DIGITAL  SOUND  GENERATION  IN  THE  TIME-DOMAIN 

In  the  fr«*quency  domain,  the  acoustic 
input  to  the  hydrophones  is  seen  to  consist 
nf  pink  noise,  with  r.indon  line  frt‘guenc’es 
occurring  either  singly  or  in  families. 

These  siiinals  are  reflected  In  the  fine- 
domain  as  a coriplex  composite  of  no  i .»•, 
single  f regu«*ncy  signals  and  multiple  fr«*- 


giiency  signals.  As  found  under  normal  oper- 
ating conditions,  the  signal  characteristics 
are  also  tine  variable,  or  st at  I st  i ca  1 1 y 
nonst  at i ona r y . 

The  composite  sound  generator  in  a sonar 
stimulator  is  typically  a self-sustaining 
parametric  system  that  ch.3nges  sound  charrac- 
terlstics  only  in  resf>onse  to  environmental 
changes.  A given  set  of  characteristics  is 
usually  determined  through  software  mode  I s 
calculated  by  a general- purpose  c^imputpr. 

The  resulting  parameters  are  then  input  to  the 
sonar  sound  generator  at  prescribed  intervals 
to  produce  an  essentially  time-varying 
scenario. 

Since  the  sound  generator  is  self- 
Svjstaining  between  updates,  much  of  the  data 
needed  to  produce  the  proper  sound  signals 
must  be  stored.  To  conserve  hardware,  the 
data  is  stored  in  as  coarse  a resolution  as 
the  simulation  will  allow  without  compromising 
the  nature  of  the  signal  used  to  stimulate  the 
sonar  system.  This  discussion  will  assume  the 
synthetic  sonar  sound  signal  to  be  digitally 
generated.  A digitally  generated  sound  signal 
is  represented  by  a series  of  binary  numbers 
generated  in  the  following  fashion-  A con- 
tinuous wave  is  periodically  sampled,  and  the 
resulting  discrete  amplitudes  are  then 
quantized  and  represented  by  a binary  number. 
This  is  illustrated  in  Figure  2. 


o DOTTED  CURVE  DENOTES  ORIGINAL  ANALOG  SIGNAL  WAVEFOR^V 
o VERTICAL  BARS  DENOTE  SAMPLED  SIGNAL 
o HORIZONTAL  BARS  DENOTE  QUANTIZED  REPRESENTATION 


TIME,  t 


Eiqur**  2.  Di<Hli/ed  Signal  and  Cor  respond  i fuj  Binary  Codf 

Pink  or  colored  noise  is  used  to  dr*srrih<*  noise  with  a nonuniform  spectrum  in  contrast  lo  white 
noise  which  is  used  to  imply  a uniform  SfK'Ctrum 
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r ron  si^npliruj  theory  it  is  known  tfi.it  if 
the  orifiin.il  w«?vr*form  cont.iins  no  siqnols 
h.winq  frequoncirs  qro.iter  Ih.inw^,  then  hy 
s.impfincj  the  .in.iloq  sitjn.il  .i  t requenc  y 

which  Is  fjre.itor  than  ?u)^  , th(‘  oriqin.if 
'.iqn.il  c«in  ho  recovered  completely  when  low- 
p.issed  by  .in  ido.il  filter  with  an  upper  cut- 
off frequency  of  . In  practical  systems, 
the  ideal  Conditions  of  s.mplin(i  thf'ory  are 
not  achievable  , therefore,  higher  sampling 
r.ites  and  different  i nt  e r p<i  1 at  i on  schemes 
must  be  used.  The  i nt er jk)  1 at  i on  process  is 
typically  performed  by  a d i q i t a I - 1 o-ana I oq 
(d/a)  converter.  The  output  is  then  filtere<l 
by  a realizable  low-pass  filter  to  discrim- 
inate against  froqui*ncy  cc^mponent  s introduced 
by  digitizing,  quantizing,  and  interpolating. 

When  digital  data  representing  various 
waveforms  sampled  at  different  r-ucs  are 
comiiined  without  first  i n t erpo  1 a t f ng  within 
the  intrasanple  space  to  form  a composite 
waveform,  incorrect  v.ilues  vyill  result  every- 
where except  where  the  samples  of  all  compo- 
nent waveforms  coincide.  One  solution  to 
this  problem  is  to  convert  each  signal  to  its 
analog  equivalent  and  perform  all  the  com- 
bining processes  either  directly  in  the  analog 
doriain,  or  in  the  digital  domain  after 
synchronizing  the  data  through  a common 
redigi  t i Zcit  ion  . An  alternate  method  is  to 
estimate  the  values  of  all  the  waveforms  at 
the  desired  sampling  tine  by  I n t e r pol  .it  i ruj 
between  the  bracketing  samples  and  using  the 
estimated  v.ilues  in  the  processing.  The 
latter  method  has  the  adv.iniage  of  keepiruj 
all  the  processing  In  the  asynch ronous  digital 


domain  without  the  undesirable  steps  of 
converting  and  recrinvert  i ng  between  the 
d i (j  I I a I and  the  anaIo<)  d<iriains.  The  net 
effect  of  estim.itin<t  the  values  of  a given 
v/.iv«'form  between  known  samples  is  a multiple 
sampling  of  the  original  analog  signal.  The 
"sampling"  in  the  digital  domain  rviy  be  <if  <i 
fiigher  or  lower  '^ate  th.in  the  original  sample, 
and  n.iy  even  be  a mere  constant  delay  at  the 
s.impled  fijnctirm.  Wh.itever  the  condition,  the 
methfid  used  t interjiolate  .ind  resample  will 
affect  both  the  amplitude  and  phas<*  spectra 
of  the  original  signal.  Since  amplitude  and 
phase  errors  in  the  spectral  doriain  iffecT 
the  ultimate  signal  displayed  by  the  sonar 
equipment,  their  effects  must  be  carefully 
studied.  Before  expounding  on  the  spectra  of 
signals  gener.ited  by  ilrne^domain  processing 
of  digitized  signals  to  simulate  acoustic 
sounds,  we  need  to  digress  to  a discussion  on 
the  source  of  these  digitized  signals. 

SIMULATING  SOUND  SOURCES 

Sound  sources  other  than  biologies  arr: 
produced  as  (a)  broadband  (pink)  noise, 

(b)  narrov/band  noise,  and  (c)  single  or 
families  of  distinct  tones.  Many  methods  are 
available  for  simulating  the  noise  sources  in 
real-time.  One  m«»thod,  as  depicted  in 
Figure  3,  uses  a uniform  spectrum  pseudorandom 
numlier  generator  that  has  a long  repetition 
cycle  to  drive  a parame t r i ca 1 1 y controlled 
bank  of  one  third  octave  bandpass  digital 
filters  to  produce  either  a broad  or  narrow- 
band  digital  noise  source  that  h.is  the 
desired  spectral  ch.i  rac  t or  i s 1 1 c s . An 


StMOL  ATI  IJ 
"VVMlTf  NOISI  ' 


NOISE  SE‘f  CTUOM 
SMAf'E  n 


PAM  AMI  }MlC 
rONTHOl S 


Mill  Ml  [) 
NOISF 


Figure  'j-  ^ Br<»atl  or  Narrow  Band  Noise  Simulator 


The  id*al  I»^/-pass  filt«  » with  .i  diarp  cut -of  I at  between  the  passhand  and  ^loptiand  produces 
a (sinx/jt)  i n t t'r  po  1 .It  ion  function  v/fiicfi  is  noric  .lusa  1 , and  hence,  not  practically  realizable. 
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'-•1 , . • I.--,  ; r»i1  f i 1 . 1 .1 1 i • 'M’.ti  I ps  , This 

- ■ .1  ’ ‘ .1  rjl.jit.il 

• * 1 ? . f ' . . : t T ^v  f i n.i  1 i jn.»  I t h.i  r h.p 

t *'•  ■ 1 r.  cl  p.-.  t ft  I i.kJ  i I ■ .{uo  1 It  ip.. 

Finu'"*  •'«  s‘'-'v  f h,  filiH,  i.  di'Hjr  v"'  f)t  ,jn 

I't  '’iin.  ti  -i  ..‘Stv'*!  ./i.Hilil  hv 

i , 1 ” t ClI  . 

Prlir  {■.  liinq  fhv  v.u  l«>ijs  d i •!  i t -i  1 
' pK)  1 . t • . I t I lii  f ry  1 dr  i vi  ? hf  ‘i  intj ) .it  or 
r ■ 1 ■ • ij  I rit ' M' . thv  liqn.il'.  r;<ist  tjr'>t  hp 
: r • p»  *•  i . In  tK,-  c-I^p  of  s t i niu  ) ,i  i or<, , 

.nly  pro,r-H.f  -ind  .i  t t • nij.M  I ' >ns  hf 

i n?  r.  •.;pjc,*  1 ,it  tfiis  pf>Int  Tn  si'-’ul.ifv  physic<jl 
d i «.p  1 .1'.  I'- vr,  j p.-twi-n  tiyctrophonps  in  .in  .irr.iy. 
B.  dr. Imp  ■.(  . i ; rop#»r  smsr*  '»f  r«  l.itivp 
-llrv-  ^lor.  .ind  .list.lftCP  "f  .1  '.iqn.ll  sourer 
..o,,lc1  be  introdu'<Ml  t f)  the  s I mu  1 .i  t i on  . When 
t I - t.  r-,,M  r proceSNluj  is  u-.rfi,  .ind  th(- 

• b'  .j*  forru.r  ( ] | .ire*  to  b<*  simu" 

J.Utd,  th*  • .'eer  ph-iSi)  rie*l.lyi*ft  <-Ir}n.i!s 

u*.  t .»)-o  • f »*c  nrit.  i ned  in  fti«'  diriit.ll 

t'.r-uin  to  for”’  .1  cofnpc>sirv  siqn.il  .*;  i t h vvh  i c t> 
to  .triv«  thr  CRT,  In  such  .1  situ.ition,  -i 
ri-^.vplinq  ot  the  sirjn.ll  will  lir*  necr'.'viry. 
v/^vn  ?hl'.  r»* '..imp  1 i tiQ  occurs  .tl  locations 


lUtii't  f t».it'  ./hi*r.*  thr  pt  In.iry  ■.irin.il  is 
'[.led,  f tw-  prn(i-','>  must  riperafr  r>n  .in 
i n 1 1 f pr  ’ i I f Off  v rsion  rif  t hr’  input  diqiful 
1 • jri,  1 1 . S u<  h r vs  .imp  1 i nrj  n f t f*n  i n t rorj.  j.  , • , 

■ r r<  r • I n ♦ Iv  spvr  ! r .i  ol  1 h*’  s i qriu  I f hu  t 

• '•.111?  ..  Tlw r* • f or.',  it  Lf?hooves  ja  to  uniur- 
f .tnd  ’he  r*  f f • ' I i n t r ' eliicrd  by  this  per  rir  ••  ss  . 

SPFCTRU/^  or  Oir,ITAL  SOUND 

Sup'posr  -1  S pet.  t r.j  1 I y sh.lped  d i 'J  i » -1 1 
nrji  siiufCr'  Is  tri  b**  Cr»nt»  i nrd  with  r)thrr 
dluitul  .Ic|n.il  Sfjiirse.  to  prrxluc.r  tf'v  .vav'-' 
frir-  ‘-hm/n  In  riqur.'  Su-  M.ii  h.*r.i*  I ' a 1 1 , , r*v- 
w.iv.  lorm  in  riejuri-  Sa  is  an  ar-p  1 i l ud»* -nortu  1 .i - 

t»'d  vrrsi(;n  i.f  I h**  pul  .*•  train  in  Flpurt*  Sb , 

.'dieti  thi*  'Modul.it  inq  sirjnal  is  shrnvn  In 
Fifjurv  Sc.  H I hr-  analoq  siqnal  in  rinijr.-  Sc 
is  a true  son.ir  '.iqnal,  with  ’he  spr*ctrum 
shown  In  Firjur.*  ' • then  the  spr'Ctru^'  of  ’hv 
d i q i ! a 1 1 y qem-r.iterj  sound  I , cal':ulit.*d  by 
crM’ipuTinr4  t hr'  con  vr*  I u t i on  of  the  Fourier 
tr-insform  of  Flqijro  Sc  ‘ with  f.h*-  Fouri.'r 
transform  of  Fiqur*-  Sb  ' . to  qive  riq-jr»*  5*^  ‘ • 
The  tie.' r i va  1 i (SI  of  these  results  are  .veil 
k nov/n  anrJ  c.in  he  found  in  any  borjF  on  sampling 
Iheriry  |3I-  The  effr-cls  of  sampling  can  be 
remove-d  by  filtr»rinq  the  wavrfor-i  of  Firjur.-  5*1 
with  a low-p.iss  flltrT  that  has  i cutoff 
frvquencv  o f . Note,  however,  il  u;^  *'  . 

siqnal  crjfMiinnent  s f rrjm  hiqh.*r  freque'ncy  bands 
will  fold  into  t host*  in  Iriwer  fr»*rjuvncy  bands 
to  produ<.e  a distortion  of  the  result  inq  rime 
drimain  siqnal  that  cannot  be  remov<*d  by 
filtering.  This  «'ff('Ct  is  knov/n  as 
"a  1 i as  i nrj , ” and  Is  one  to  be  »voirted 
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A Line  Family  Generator 
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TIMf  -DOMAIN 


FKf  QUINCY  • domain 


ri^ure  . p-ectnini  T /fiinpled  Gonar 


With  this  introduction  to  thr  spoctr.i]  The  output  rpsponsr  to  »•.  ft)  is  »hon 

pffpcts  of  Scinplinq,  wp  Crin  procoed  to  thp 
business  of  pxamininq  how  Intprpoint  Ion 

.ind  rcs^mpl  inq  .if  f»-(  t thn  * f>PC  T rum  of  t he  c*  ( t ) = A I u j ( t ) - u j ( t -T>  | ?) 

siqn«ils  th.lt  are  produced, 


SPECTRUM  OF  INTERPOLATED  SOUND 

Starting  with  a sampled  signal,  it  is 
possible*  to  fill  in  the  intrasampip  region 
by  some-  I n t erpf)  I a I i nq  function.  Two  corifTMinly 
used  po  1 ynrxni a 1 interpolators  are  the  zero- 
order  I n te rpfj  1 ator  ( samp  1 e-and -ho I d as  in 
Figure  6a)  and  the  first-order  i n t er po  1 at f>r 
(linear  interpolator  as  in  Figure  6h)  . 


where  u |(x)  is  leMned  to  be  a unit  step 
occurring  at  * - 0.  The  impulse  response  of 
a Zero“ord«r  hold  ..  i r*  • N is  thus  the  diftpr* 
enct*  between  tv-yo  unit  steps  shifted  by  T in 
tif'M'.  Taking  the  Laplace  transform  ot  . -i) 

give,  the  transfer  functi<vt  f>f  the  Zei 
order  hold  ciriuit  to  t»e 


1 

s 


l-o"'  (?) 


The  zero-order  interpolator  consists 
of  a circuit  that  will  hold  an  impulse  input 
at  an  amplitude  egual  to  the  "amplitude" 
of  the  impulse  f ron»  the  time  It  occurs,  until 
some  time  t * T later,  at  which  t im<*  another 
impulse  occurs.  The  interval  T is  usually 
the  perif)d  of  th«*  sampling  function  p(t). 
Slated  formally,  the  Input  of  one  impulse  with 
"amplitude"  A occurring  at  t » 0 is 

(,)  ^ AAft)  (I) 

I n 


By  Substituting  for  s and  CoseJT  - j sinu;T 
for  e"‘  we  get  the  amplitude  and  phase 
s pet  t rum  to  be 


Thr  lime-domain  response  of  a sample  and  hold 
circuit  to  an  Impulse  input  function  and  the 
amplilutle  and  phase  spectrum  of  tht-  zero 
order  inlirpolat ion  circuit  are  given  in 
Figure  7. 
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(a)  ZERO-ORDER  HOLD 


T 


*))  LINEAR  INTERPOLATION 


Figure  6.  Zeroth-  and  First-Order  Interpolation 


Suppose  f(t)  is  a bandlimited  function 
that  is  sampled  by  a periodic  train  of 
impulse  functions  p(t)  to  form  f*(t).  If  the 
Fourier  transform  of  f(t)  is  F (ui)  and  the 
period  of  p(t)  is  T,  then  the  Fourier 
transform  of  the  sampled  wave  f*(t)  is  given 
by 

irk/T)  (5) 

If  f*(t)  is  passed  through  the  zero- 
order  hold  circuit,  the  resulting  signal  is 

given  by  the  convolution  of  f*(t)  with  the 
impulse  response  of  the  zero-order  hold 
circuit.  That  is, 

^(t)  - f*(t)  ©g^(t)  (6) 

where  O denotes  the  convolution  operator. 
With  Ch(tJ)  the  Fourier  transform  of  q^ft), 
the  Fourier  transform  of  f(t)  is  given 


by  the  product 

F(w)  - F*M  ■ GhM  (7) 

The  zero-order  hold  function,  therefore,  act* 
as  a low-pass  filter  with  a phase  lag. 

To  understand  the  impact  of  time-domain 
processes  on  simulating  sonar  and,  in 
particular,  beamforming  in  a hydrophone  array, 
it  is  necessary  to  analyze  such  a system^  . 

By  way  of  illustrating  the  effects  and  the 
need  for  such  analysis,  an  example  is 
presented. 

THE  SPECTRA  OF  A 

SIMULATED  CIRCULAR  HYDROPHONE  ARRAY  BEAMFORMER 

Let  the  hydrophones  forming  an  array  lie 
in  a circle  and  an  acoustic  wavefront  ripple 
through  this  sensor  array  as  shown  in 
Figure  8.  At  any  instant  in  time,  the  source 
signal  sampled  by  a given  sensor  will  be 
phase  related  to  the  same  signal  sampled  by 
any  other  sensor  in  the  same  array. 


tin  some  cases,  it  is  easier  to  simulate  the  results  of  a beamformer  shown  on  a spectrum 
analyzer  by  modeling  in  the  frequency  domain.  However,  in  general,  other  constraints  would 
make  such  an  approach  even  nxjre  difficult  than  straight  time-domain  methods. 
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G^(a;)A 


Figure  7.  Characteristics  of  the  Zero-i)rder  (told  Interpolator 


Figure  d.  An  Acoustic  Wavefront  Sweeping  Fast 
a Circular  Array  of  Hydrophones 


In  a simulation,  suppose  a siqnal 
sampled  with  period  T is  used  as  the  source 
to  drive  a sensor  array.  Let  the  ith  array 
element  be  physically  located  such  that  at 
each  simulation  system  clock  time,  the  true 
value  of  the  siqnal  it  should  be  sampi inq 
lies  between  successive  samples  available 
f rrjm  the  sampled  siqnal  source.  As  shown  in 
Fiqure  9,  let  the  relative  time  location  of 
the  sample  required  by  the  ith  array  element 
occur  after  a delay  of  4.,  where  0 < 4j<T, 


following  the  last  known  digital  source 
siqnal  that  had  passed  the  ith  array  element. 
Also  suppose  the  signal  value  actually 
received  by  the  ith  sensor  to  be  approximated 
by  linearly  interpolating  between  the  two 
source  siqnal  samples  that  sandwich  it,  viz, 

A and  C in  Figure  9.  Finally,  the  operation 
assumes  the  delay  4.  for  the  ith  array 
element  is  constant  for  a given  target  signal 
arriving  from  a given  spatial  direction. 
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Fit;ure  9-  Signal  Sampling 


A = l.ist  source  siqna)  sample  that  passed  1th  array  element 

B = expected  siqnal  sample  location  by  ith  array  element  at  system  sample  time 
C • next  source  siqnal  sample  that  will  pass  over  ith  array  element 


The  problem  is  to  analyze  the  amplitude 
and  phase  error  that  is  introduced  when  the 
stimulating  siqnal  is  derived  in  this  manner. 

analysis 

ttathenat  i Ciil  Description  of 
Approximation  Process 

Let  p(t)  be  the  samplinq  function  with 
p*-riod  T and  finite  samplinq  window  X. 

If  the  f(t)  is  the  oriqinal  siqnal  that 
is  to  be  simulated,  then  the  sampled  version 
of  this  siqnal  source  f*(t)  is  written 

(8) 


Since  p(t)  is  a periodic  function,  it  can  be 
expanded  into  an  exponential  Fourier  Series. 

“ T., 

where  C,  Is  the  kth  Fourier  series  coefficient, 
k 

Substituting  Equation  (9)  into  Equation  (8) 
q i ves 

f*(t)  - y.  „CMf(t)exp(j2i»kt/T) 

(10) 

This  equation  is  the  time  domain 
description  of  the  siqnal  f*(t)  which  results 
from  uniformly  samplinq  the  oriqinal  continu- 
ous siqnal  f(t)  by  the  periodic  samplinq 
funct ion  p( t) . 


f*(t)  • f(t) •p(t) 


I 


Utl 


A 

f(t)  * sampled  source  signal 

f(t)  * linear  approximation  ()f  source  siqna! 


Figure  10.  Linear  Approx  ifiiat  i on  of  Source  Signal 


Suppose  function  h(t)  is  generated  by 
linearly  interpolating  between  successive 
values  of  f*(t).  The  approximate  value  of 
the  signal  received  by  the  ith  sensor, 

S.(t),  on  the  other  hand,  is  derived  by 
taking  the  value  of  h(t)  at  time  tj,  where 
the  delay  (tj  " ^n-l)  from  the  past  value 
f*(tn-l)  is  6j.  At  time  t(j,  function  h(t)  is 
written 


h(td) 


n n ' I 

. T 


( t ,-t  , ) 

d n- 1 


A Derivation  of  the  Spectrum  f • ( t ) S 
h Tt)  as  a Funct  ion  of  the  Sp(>ctrum  of  fft) 

Let  F(tj)  be  the  Fourier  transform  of 
f(t)  and  F*(cj)  the  Fourier  transform  of 
f*(t).  Then  by  the  frequency  shifting 
t heorem 

[ej^^f(t)]  - F(co-'^)  (13) 

Equation  (10)  becomes,  in  the  Fourier  trans- 
form domain, 


(n)  (iJ  - 2 If  k/T)  (Ik) 


Equation  (II)  can  be  rewritten  to 
derive  the  sampled  function  h*.(t)  by 
appropriately  time  shifting  f*(t)  to  give 

h*.(t)-  [ff'(t+T-6,)-fMl-6^)  ] A./T 

♦ f*(t  - A.)  (>2) 

T and  Aj  are  constants.  Equation  (12)  assumes 
a steady  state  condition. 

In  order  to  assess  the  magnitude  of  the 
additional  amplitude  and  phase  error  that  is 
introduced  Into  the  reconstructed  signal  when 
M(t)  Is  used  in  the  place  of  f*(t),  we  need 
to  derive  the  spectrum  of  both  functions  in 
terms  of  the  spectrum  of  the  original  signal 
f(t). 


Equation  (Ik)  relates  the  spectrum  of  f*(t) 
to  that  of  f ( t)  . 

If  H . (uj)  is  the  Fourier  transform  of 
H .(t),  then  by  the  time  shift  theorem, 

3F|f*(t  - t^)l  . F(cu)e'j‘o“  (15) 

we  get  from  Equation  (Ik)  the  relationship 
between  the  Fourier  transform  of  h*|(t)  and 
the  Fourier  transform  of  f(t)  to  be 
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A 


approx  im.it  ion  used  to  qenerate  h*(t). 


2»k,  . 

- JGJ 


(e- lu)(  * . -T) -c- 

Note  that  H|(u))  Fa(u))  for  = ^0,  t) 


Rewritinq  Equation  (16)  yields 


H . (lj) 


2 w k 


(I  - ^-)  e 


.Ujf). 
■J  • 


*i  -i‘^(6.-T) 


(16) 


(17) 


Which  further  reduces  to 


[e. 


AMe 


(18) 


where  A(cj)  and  are  the  amplitude  and 

phase  modifications  to  the  spectrum  of  the 
original  sampled  source  signal  caused  by  the 


The  relative  amplitude  error  introduced 
is  |1  “ A(a))  I while  the  phase  error  intro- 
duced 1 s C((^)  . 

By  comparing  the  spectrum  h(w)  given  by 
Fquat ion  (17)  to  that  of  the  initially 
sampled  function  f*(t).  viz. 


FA(cj) 
we  get  the 


spectral  error  function 


(19) 


f I (tj) 


= (1  - 4-) 

il_  (fi,  - T) 

T 


(20) 


Convert inq  the  error  function  in 
Equation  (20)  into  the  amplitude  and  phase 
format,  and  then  simplifying,  yields  the 
amplitude  and  phase  error  as  a function  of 
the  resampling  delay  6 and  the  frequency  cj. 
Figure  II  shows  the  typical  amplitude  and 
phase  error  variations  as  a function  of  6 in 
the  range  |0,T  I , where  T is  the  period  of 
the  master  sampling  function  p(t). 


Figure  11.  Error  Variation  as  a Function  of  6 
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Figure  12.  Maximum  Amplitude  and  Maximum  Phase  Error 


Solving  for  the  maximum  amplitude  error 
t^(max)  and  the  maximum  phase  error  (^(max) 

in  terms  of  frequency  tJ,  we  qet  the  following 
S i mp 1 e expre ss i ons : 


, , l-/o-5  I I + Cos(2>iX)  I (21) 

< . ( max ) * 


-(max) 


arctan  | -tan^  ( if  X/?)  1 


(22) 


where  xi  j is  the  ratio  of  the  signal  fre- 
quency w to  the  sampling  frequency  ca  • 
results  are  plotted  in  the  graph  in 
figure  12.  As  expected,  both  the  amplitude 
error  and  the  phase  error  drop  to  negligible 
values  as  the  frequency  of  the  signal  becomes 
small  in  cfjmparison  to  the  sampling  frequency 


To  form  a "beam",  signals  from  each  of 
the  hydrophones  /h.^  in  the  array  arc 
delayed  by  time  2i- * mul  t i pi  i ed  by  a pre- 
scribed weight  w.  and  summed  together  to  give 
the  Cfxnposite  result 


s(t)  • y*  . , w.h.(t+A.) 

trf  ,»1  j I I 


(23) 


If  S ■ (oj)  denotes  the  Fourier  transform  of 
the  sampled  <jnd  linearly  interjK>lated  version 
€>f  the  com(;K)slte  hydrophone  array  signal 
s (t),  then  the  next  error  introduced  by 
simulating  the  sonar  signal  in  the  pre- 
scribed n)ann<*r  will  be 

• (^)  ■ 5^  ■ I w.  * , (u>)  (2^) 

s ^j-1  j I 


The  actual  values  of  b.  in  Equation  (2^) 
as  reflected  through  Equation  (20)  are  a 
function  of  the  geometry  of  the  array  modeled 
and  the  relative  angle  of  arrival  of  the 
acoustic  wavefront. 

CONCLUSIONS 

The  advantages  of  digital  signal  pro- 
cessing have  received  considerable  publicity. 
For  modern  sonar  simulation,  it  is  seen  that 
considerable  analysis  is  possible  to  predict 
the  effects  of  operating  completely  in  the 
digital  domain.  This  paper  has  chosen  one 
example  to  show  hov/  such  an  analysis  can  be 
accomplished.  The  same  can  be  achieved  for 
a myriad  of  different  other  simulation 
methods  which  are  available  to  the  designers 
of  real-time  sonar  simulators  for  use  in 
training  suites. 

As  new  sonar  synthesis  equipment  gets 
introduced  into  the  fleet,  and  the  task  of 
proper  simulation  becomes  increasingly 
difficult,  a preliminary  analysis  of  any  pro- 
posed meth('d  will  point  out  the  strengths  and 
weaknesses  of  each  model.  The  results  of  such 
analyses  will  aid  : designers  in  their  quest 

to  prcxluce  real-tie^  • ind-based  simulation 
trainers  that  will  'inue  to  lighten  the 
load  on  operational  .yatems.  In  t-his  way, 
such  trainers  will  truly  be  a solution  that 
will  conserve  our  precious  resources  to  be 
used  in  more  effective  applications. 
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